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I. INTRODUCTION 


A. OBJECTIVES 


The objective of this thesis is to design and test a prototype expert system to assist 
deminers and Explosive Ordnance Disposal (EOD) technicians in identifying landmines. 
The prototype is based on the Bosnian subset of landmines from the MineFacts database. 
A successful expert system will assist an inexperienced deminer in quickly identifying a 
landmine, based on its distinguishing characteristics. This will make demining safer and 
more efficient. The prototype expert system has direct application in humanitarian 
demining and could eventually be expanded to cover all landmines. The prototype also 
demonstrates that an expanded system could be useful in identifying all other types of 
unexploded ordnance (UXO). Such systems would make valuable expert EOD 
knowledge available to all EOD personnel and enhance the speed and accuracy of 


identifying ordnance. 


B. BACKGROUND 


Landmines have become a serious problem in the world today. As a weapon of 
war, they are a cheap, effective way to channel the enemy and protect vulnerable areas. 
Unfortunately, landmines are rarely removed after a conflict and as a result, there are now 
over 110 million mines scattered across 60 countries [UNIT 97]. Landmines remain 


lethal indefinitely, and over 26,000 people are injured or killed annually because of them 


[TERR 94]. Because of this problem, the new field of humanitarian demining has 
emerged to clear mines from former battlefields, thereby making them safe, habitable 
places once again. 

Planting landmines is easy - removing them has proven to be a much more 
difficult problem. Over 700 types of landmines are used in the world today. About 100 
new types have been developed just over the past three years [UNIT 97]. Each type of 
mine is unique and may have one of many different types of firing systems. The removal 
technique for one mine may cause another type of mine to function, so before any mine 
can be safely removed, it must first be positively identified. For this reason, computer 
based training programs and landmine identification systems are vital in assisting 
inexperienced humanitarian deminers. Furthermore, these programs can help make up for 
the shortage of qualified experts by extracting years of EOD knowledge and making it 
widely available. 

The MineFacts Database is one type of landmine identification system presently in 
use. It was developed by the Humanitarian Demining Program Office of the U.S. Army 
Night Vision Electro-Optical Directorate and ESSEX Corporation [MINE 97]. 
MineFacts has been fielded to Bosnia, Cambodia, and other nations to assist humanitarian 
deminers. The current interface for the database is a simple query, based only on the 
mine’s size, shape, country of manufacture, and casing. During the selection process, no 
visual assistance is given to the user, and possible matches are displayed simply as a list 
of landmine nomenclatures. Depending on the aan given, this list could vary 


from a few landmines to hundreds. An expert system is ideally suited for improving the 


MineFacts database. It could be used to select a group of landmine candidates based on 


more information, narrowing down the final selection. It will still require the deminer to 


make the final identification, but it could present pictures of possible landmine candidates 


for the selection. Furthermore, the candidates will be presented to the user with a level of 


confidence of how well they meet the attributes specified in the search. It can provide a 


faster, more efficient search method with more varied information [QUIN 89]. 


cS. 


THESIS QUESTIONS 


The following questions are addressed in this thesis: 

¢ Can an expert system be useful in landmine identification? 

Currently, all identification is based on the deminer’s knowledge or access to 

publications. Mines are examined and then painstakingly matched to pictures in 

the reference books for identification. This is a very time consuming process 

which is prone to errors. 

e How is expert landmine knowledge described? How is the knowledge best 
extracted? 

Expert knowledge is difficult to understand and model. In order to create an 

expert system, an examination of the methods used by experts to identify a 

landmine must be conducted. Once this method is understood, the knowledge 

must be captured and displayed in a format useful to the non-expert user. 


e What methodology is best suited for the landmine identification problem? 


This problem 1s similar to other identification problems but it has some unique 

points. Unlike other items to be identified, the landmine cannot always be 

painstakingly studied and examined. Often, the information gathered on the mine 

will be missing fields or will be an approximation. The methodology used must 

take this uncertainty into account when presenting a solution. 

e What questions and sub-questions are best to implement an expert system that 
will integrate well with the MineF acts database? 

Questions are developed from the fields available in the MineFacts database. 

These questions are based on an EOD technician’s landmine reconnaissance 

technique. Each question must be logically examined to determine how it may be 

affected by situations that are unique to landmine warfare. 

e What are possible applications for similar expert systems that could be 
applied to other EOD databases? 

There is currently no decision support tool available for EOD Technicians. 

Application of an expert system to the other EOD databases could improve 

accuracy and speed of UXO identification. There are over 5,000 items currently 

in the EOD publications set, and a mistaken ordnance identification could be fatal 


for the EOD technician. 
D. ORGANIZATION OF THE STUDY 


This thesis presents the use of a prototype expert system for ordnance 


identification. 


Chapter II provides background information regarding landmine warfare and 
expert systems. Background is also given on landmine clearance and 
unexploded ordnance clearance. Finally, an explanation is provided of the 
MineFacts database and the 60-series EOD database. 

Chapter III presents the methodology used in the implementation of the expert 
system. Each field of the MineFacts database will be examined and 
appropriate metrics and questions will be proposed. An evaluation of each 
question will also be given, focusing on the logic used to generate the 
question. 

Chapter IV presents the implementation of the prototype expert system. 
Analysis of the efficiency of the prototype will be discussed. This chapter also 
covers the user interface and hardware requirements. 

Chapter V gives a summary of the thesis, the expert system design and the 
working prototype. Also, recommendations are given for future study based 
on the conclusions drawn from the prototype. Finally, recommendations are 


given for expanded use of this technology in EOD operations. 
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il. BACKGROUND 


A. LANDMINE WARFARE 


L History of Landmines 

Modern landmines first gained popular use in World War I as the German 
response to the new British tank. The term “mine” comes from the earlier practice of 
tunneling under an enemy’s fortifications and placing explosives to breach their defenses. 
Early landmines were simply artillery shells with contact fuzes. These shells were buried 
fuze up in the hope that enemy tanks would be stopped during an assault [SLOA 86]. 

Landmines became more widely used in World War If. In some cases minefields 
were laid miles wide in an attempt to stop enemy armor. World War II also saw the rise 
of antipersonnel mines. These mines were initially developed to protect antitank 
minefields, but were later used specifically against the infantry soldier [SLOA 86]. As 
mine clearance techniques improved, so did techniques to prevent their removal. Anti-lift 
and anti-handling devices were developed. Fuze functioning, which had previously been 
limited to pressure actuation, expanded to include pressure release, tripwire and 
command detonation. In addition to new actuation techniques, mine construction was 
improved with the use of non-metallic materials such as plastic and bakelite to make 
mine location more difficult [STOF 72]. 

The last 50 years has seen the largest growth in landmine technology. Mass 


production has made them cheap and reliable. Construction materials have improved, 


and completely non-metallic mines are in use in many areas. Fuzing technology has 
advanced to include magnetic influence, seismic influence, anti-disturbance and selective 
targeting [HIDD 94]. Scatterable mines now allow placement to be done mechanically or 
by artillery, increasing the number of mines deployed and making tracking them nearly 
impossible. These new advances have made modern mines prolific, harder to detect and 


more deadly. 
Ze Classification of Landmines 


There is a great deal of variety amongst modern landmines. Each country 
produces their own designs and there are over 700 unique landmines in use in the world 
today [MINE 97]. This number does not take into account outdated mines already in the 
ground which are no longer used but still present a hazard. Mines may be classified in 
several ways. The most common classification is by intended target: antitank or 
antipersonnel. These two major groups are further sub-divided into more specific 
categories such as anti-vehicular, multi-use, alarm, and illumination. Within the two 
major groups mines can be classified by size, country of use or manufacture, effect, 


method of emplacement, and method of actuation. 


Antipersonnel mines are usually small in size and come in a variety of shapes 
(Figure 2.1). These mines are intended to cause personnel casualties by means of 
fragmentation or blast. They can be either buried or surface laid, and the newest mines 


can be scattered by machine, artillery, or aircraft. Depending on their size and design, 


antipersonnel mines can produce casualties up to 100 meters away. Antipersonnel mines 
may be actuated by pressure, trip wire, magnetic influence or command detonation. 
Antipersonnel mines are usually smaller than six inches in size and rarely contain more 
than one kilogram of explosive. 

Fragmentation mines come in three varieties: omni-directional, directional, and 
bounding fragmentation. Injuries from omni-directional fragmentation mines are caused 
by shrapnel from the mine case. The mines can be buried or surface laid but the are often 
mounted on a stake above the ground to increase their killing radius. Directional 
fragmentation mines are designed to control the direction of the fragmentation. This is 
normally accomplished by embedding steel balls into one side of a block of explosive. 
Bounding fragmentation mines are considered the most menacing of all fragmentation 
mines. They are buried below the ground and function when a tripwire or pressure fuze is 
tripped. When this occurs, a small explosive charge launches a fragmentation projectile 
into the air. This projectile detonates around one meter off the ground maximizing the 
fragmentation radius of the mine and causing traumatic upper body injuries. 

.All of the early antipersonnel mines were fragmentation mines, but many new 
mines are now blast only. Blast mines cause casualties by the explosive force of the 
mine’s detonation. They are almost exclusively pressure actuated, as this assures the 
victim is in close proximity to the explosion. Blast antipersonnel mines are generally 
produced in 40 gram and 200 gram explosive weights. The smaller mines are meant to 
blow off a foot, while the larger mines can cause amputation of the entire leg or even 


death. 





Figure 2.1 Yugoslav PMA-3 Antipersonnel Mine 
This is a pressure actuated, blast antipersonnel mine. It is constructed of plastic and 
rubber and contains 34.5 grams of explosive. The photo shows a deminer removing the 
fuze [MINE 97]. 


Antitank mines are always larger than antipersonnel mines. They are also most 
often pressure actuated, but may be set off by magnetic influence, tilt-rod, command 
detonation, seismic influence or even infrared [MINE 97] [SLOA 86] [UNEX 94]. These 
mines are normally fuzed to prevent actuation by an individual soldier, but they are 
normally protected with antipersonnel mine or anti-removal devices. Antitank mines are 
five inches or larger, with most being a foot or more across. They can be buried, surface 
laid, or scattered by artillery, machinery, or aircraft. 

There are several varieties of antitank mines: blast, shaped-charge, or Miznay- 
Schardin. Blast type mines often contain more than ten kilograms of explosive and are 
designed to damage a tank or destroy a light vehicle. Shaped-charge Tne attempt to 


pierce the hull of a tank using an explosively formed jet of gas and molten metal. They 


10 


can penetrate armor several inches thick, and are sometimes used to attack vehicles from 
the side. These mines are emplaced next to a road, horizontally with the ground. A 
passing vehicle trips the mine and the shaped-charge fires into the side or rear or the 
vehicle. Miznay-Schardin mines are “belly attack mines,” so called because when 
tripped, they throw a curved steel plate into the “belly” of the tank. This plate strikes the 
hull with such force that metal spalling occurs on the inside surface of the hull. These 
metal fragments kill the crew inside the vehicle. 
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Figure 2.2 Former Soviet TM-62M Antitank mine 
This mine is a metal cased, antitank blast mine. The TM-62 was the mainstay of the 
Soviet antitank mine inventory. It accepts a variety of fuzes and comes in four different 
models [MINE 97]. 
There are a few other ways that mines can be classified. The way a mine is 
emplaced is sometimes used to classify mines. Some classifications are scatterable, 


manually emplaced, buried, stake, or surface laid. Mines manufactured by one country 


often have similar features and are sometimes referred to as a “family” of mines. Mines 
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that belong to a family may have completely different firing systems from each other and 
due to their similar outer construction can sometimes be very difficult to tell apart [SAPP 
90]. Some mines can also be recognized by non-standard design features such as an 


unusual shape (Figure 2.3) or the use of an unusual case material, such as concrete. 





Figure 2.3 Former Soviet Union PFM Antipersonnel mine (shown to scale) 
This scatterable mine is also known as a butterfly mine and is often picked up by 
children. It is usually employed in clusters ranging from 1,000 to 6,000 mines and can be 
delivered by helicopters or high-performance aircraft [MINE 97] [UNIT 96]. 


3. Future Trends in Land Mine Technology 


As the technology used to locate and disarm landmines improves, so will 
technology to avoid detection and location. Recent years have seen a large growth in 
plastic mines and this has all but eliminated the effectiveness of magnetometers for 
detection. Future mines will attempt to avoid detection by incorporating a shielding 
scheme against high-energy detectors or will be sealed to avoid chemical detection by a 
sniffer. Mines may also have new firing systems that will detonate when they sense an 


active detection system, such as a magnetometer or high energy detector. New firing 
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systems incorporating microchips will allow mines to identify friend or foe and select 
targets of higher value such as communications vehicles. 

Politically, landmines are losing their appeal as acceptable weapons. There is a 
move to ban the use and production of landmines, and the U.S. has joined in the 
international moratorium on their use. This moratorium does not include the new “smart 
mines’, which are designed to self-destruct some time after they are deployed. While 
self-destruction will remove a large number of mines, 5-10% of the mines are likely not 
function as designed and will remain live in the minefield [TERR 94]. Even if the 
moratorium 1s accepted worldwide, there are still over 110 million mines that must be 


removed from existing minefields [TERR 94]. 
4. Landmine Clearance 


Once a landmine is in the ground, it takes a tremendous amount of effort to 
remove it. It is estimated that it costs three dollars to produce a mine and one-thousand 
dollars to remove it once it 1s in the ground [TERR 94]. These costs are a result of the 
difficulty and danger involved in landmine clearance. There are basically two approaches 


to landmine clearance: the tactical military method and the humanitarian method. 
a. Military Mine Clearance 


Landmines are a nuisance to military forces. As a weapon, they are only 
effective in channeling the enemy’s maneuver or harassing ground troops. When a 


military force encounters a minefield, they will either change direction to bypass the 


hs 


obstacle, or attempt to breach the minefield to continue their advance. Breaching will be 
accomplished with mine rollers or some other mechanized method if possible, or 
explosively with a mine clearing charge such as a Mine Clearing Line Charge (MICLIC). 
Mines are only removed by hand when these other options are not feasible, or for lone 
mines. When hand removal is used, the deminers will remove the minimum number of 


mines necessary to allow the mission to continue [SAPP 90]. 


b. Humanitarian Demining 


Humanitarian demining is a relatively new concept. It has come about as a 
result of the proliferation of landmines in small regional and civil conflicts. Because the 
mines are very cheap, they have gained wide use in third world in countries, which are 
not equipped to remove them after a conflict ends. Countries like Cambodia, 
Afghanistan, Iraq and Somalia are a sampling of the 60 countries where mines have been 
used in recent years [UNIT 96]. Humanitarian demining came about to remove those 
mines and make the land habitable again. 

The first principle of humanitarian demining is that one hundred percent of 
the mines must be removed. This differs from military mine clearance in Strategy, 
methodology and goal. Each mine must be located, identified and rendered safe. Unlike 
military mine clearance, deminers must avoid detonating any landmines as this will 
contaminate the minefield with shrapnel and undetonated explosive and hinder future 


searches with magnetometers or explosive sniffers. For this reason meticulous care is 
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taken to find every mine, properly identify it and then remove it for destruction elsewhere 
[TERR 94]. 

Humanitarian mine clearance also differs from military mine clearance in 
the level of expertise of its technicians. Humanitarian deminers are often local people 
who have been trained to remove the mines. They are often inexperienced and, unlike 


military EOD personnel, have little reference material to assist them. 
C. Unexploded Ordnance Clearance 


UXO clearance is often confused with mine clearance. While it is similar 
in many aspects, it is fundamentally different in location, identification and methods of 
disarming. A UXO is a dangerous, uncontrollable piece of ordnance that failed to 
function as it was designed. This type of clearance takes place on the battlefield and also 
on former firing ranges here in the United States. UXO’s are usually found on the surface 
which makes them easier to locate than landmines. However, UXO identification is 
much more difficult than for landmines due to the huge variety of ordnance in use in the 
world [TERR 94]. Once identified, the neutralization of the item is often complicated by 
the unstable condition of the ordnance. 

In the past few years, the U.S. military has closed many installations in the 
U.S. and overseas. These bases often had firing ranges and impact areas which contain 
huge numbers of unexploded ordnance. Clean-up operations on these installations have 
some characteristics from both military mine clearance and humanitarian demining. 


These operations work to achieve 100% clearance, but are not limited in detection 


IS 


methods or in methods of disposal. Because UXO’s are generally metal cased, they are 
easily located, and once identified are often relatively safe to move to a disposal area. For 
this reason, this type of ordnance contamination problem may benefit from a similar 


expert system approach as the one described here for landmine identification. 


B. EXPERT SYSTEMS AND DATABASES USED FOR OBJECT 
IDENTIFICATION 


1. Expert Systems 


Ever since computers were invented man has tried to make the machine think like 
a human. An expert system attempts to use human knowledge to solve a problem that has 
traditionally required human intelligence to be solved. More specifically, an expert 
system is, “a computer-based system that performs at the level of an expert in some 
specialized domain using domain specific knowledge (usually acquired from experts)” 
[BHAR 96]. This domain specific expert knowledge 1s represented by heuristics or “rules 
of thumb” within the computer. This differs from the ordinary algorithmic computing 
method where the computer has very little knowledge and solves tasks based only on a 
basic algorithm and set boundaries for the problem. An expert system contains a large 
knowledge base, uses symbolic logic rather than an algorithm, and applies knowledge 
appropriate to the problem to reach a conclusion. These attributes allow the program to 
solve a vast array of problems within its domain of knowledge. An algorithmic program 
may have to be reprogrammed for each new problem, because the algorithm and 


knowledge used to solve the problem are integral to the program’s design [WIDM 96]. 
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Humans solve problems in a very different way from a computer. The human 
mind integrates bits of knowledge retrieved from a large collection of experience to solve 
a problem. If a problem is too large, the human expert will break the problem into 
smaller parts. The expert system attempts to mimic this process - rules are used to 
represent those small fragments of human knowledge and a database is substituted for a 
range of experience. Problems are broken down into manageable parts, which are applied 
to the knowledge base. This allows even unfamiliar problems to be solved, if the rules in 
the knowledge base are sufficient to create a path to a solution. One advantage of an 
expert system over a human expert is that the program can explain explicitly how it 
arrived at a conclusion and give a level of confidence for the answer [PCAI 97] [WIDM 


96]. 


User Interface 


Inference Engine 


Knowledge Base 





Figure 2.4 Shows the components in an expert system and their interaction [WIDM 96]. 
An expert system is usually composed of a user interface, an inference engine, a 

standard database, and a knowledge base (Figure 2.4). The knowledge base consists of a 

series of heuristics, in a IF-THEN format. The user interacts with the user interface to 


input the information the expert system requires. This information is passed to the 
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inference engine which integrates the data provided by the user with expert knowledge 
from the knowledge base and with data specific to the problem from the database. The 
inference engine then attempts to use all this data to make sub-conclusions and 
conclusions about the problem [PCAI 97] [WIDM 96]. 

One very common part of most expert systems is the explanation subsystem. This 
feature allows the user to query the system about conclusions it has made and trace back 
through the reasoning used to arrive at that conclusion. Because expert systems represent 
human knowledge in formal rules, the explanations of reasoning used to reach a 
conclusion are produced in the same natural language format in which the rules are 
written [PCAI 97] [WIDM 96]. 

Expert systems are used for a variety of tasks including diagnostics, data 
interpretation, object classification, and construction [BHAR 96]. They can be applied to 
these problems in two ways. In a decision support role, they can be used to remind an 
expert of options that can be considered or information that may have been overlooked. 
This use is most commonly seen in medical expert systems. The second way an expert 
system can be applied is as a decision maker, to allow a person with little knowledge to 
make a decision above their level of experience. This application is most often used in 
manufacturing and industry [WIDM 96]. 

An example of a medical expert system is MYCIN, an expert system that was 
designed to diagnosis meningitis and blood infections and then recommend treatment. 
MYCIN was developed in the early 1970's by Dr. Edward Shortliffe at Stanford 


University, and though it never gained wide clinical use, it did serve as a template for 
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future diagnosis systems that are in use. Its major impact on expert system programming 
was its ability to clearly explain its conclusions. [WIDM 96] [FORT 89] [HART 86] 
[SLAT 87] 

MYCIN used about 400 heuristic rules to reach a conclusion. These rules were 
written in an “IF-THEN” type structure [SLAT 87]. These heuristics were probabilistic 
in nature. This allowed MYCIN to make some diagnoses with uncertain information, 
based on some “certainty factor” [FORT 89]. MYCIN was able to explain its diagnosis, 
by tracing back through its rules and giving the user its reasoning from each rule. 

Expert systems have gained wide use in other areas. One example is the system 
used by credit card companies to check credit transactions. The system rapidly makes a 
decision whether to extend approval for credit whenever the credit card is used by the 
customer. Other popular uses include grammar checkers in word processing programs 
and “wizards” in popular software packages. [WIDM 96] 

Expert Systems do have some drawbacks. The knowledge base is restricted and 
there may be an instance where the question is beyond the systems domain of knowledge. 
Problems outside the knowledge base cannot be solved without adding to the knowledge 
base. Also, if the rules for the expert system are not correctly entered, there is the risk 
that some conclusions may be wrong. This should be identified in testing, but if the error 
is small, it may be missed. The system would treat this rule as correct and make 
explanations based on this rule since it has no way of determining if the rule is in fact 


correct. [BENE 89] 
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Di Current Expert Systems for Ordnance Identification 


There are currently no expert systems in use for ordnance identification. The 
EOD field has only recently seen the use of automation with the arrival of CD-ROM 


references in 1994. These electronic references are discussed below. 
3. Explosive Ordnance Disposal Databases 


The U.S. military has developed several ordnance databases for EOD. The most 
important is the 60-series publication used by all branches of the U.S. Military. This joint 
service series of publications is used by EOD technicians to identify over 5000 types of 
ordnance and contain specific information on how to render each of these items safe. 

The 60-series has recently been placed on CD-ROM, but previous versions were 
on paper and microfiche format. Both the paper and CD-ROM sets consist of an 
Identification Guide and a collection of individual publications for each piece of 
ordnance. The Identification Guide contains line drawings of ordnance ordered by size, 
and is used as an index to find the correct publication for an unknown item. To make an 
identification, the EOD technician makes a close measurement of the unknown item. The 
technician must then make a subjective judgment about what kind of ordnance the item 1s 
(bomb, projectile, submunition, landmine, etc.). Then the Identification Guide for that 
type of ordnance is selected and the pictures in the guide are compared to a drawing made 


by the technician during his reconnaissance. Once the unknown item is matched, the 
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Identification Guide will list the 60-series location where the render-safe procedures and 
other detailed information on the ordnance can be found. 

This 60-series identification method does present some problems when 
information is incomplete or incorrect. If the EOD technician fails to properly identify 
the type of the item (e.g. he calls a landmine a submunition), then he will be looking for 
the unknown item in the wrong book. Also, since many types of ordnance are similar in 
size, a large number of items must be screened to find the correct item. Moreover, if the 
technician is unable to get a measurement, the entire guide must be searched to find a 
match to the picture. 

The method for locating an item on the 60-series CD-ROM has not changed from 
the paper and microfiche version, and the process still requires tedious searching to make 
an identification. Ordnance is still searched by type and size, using an automated 
Identification Guide. The CD-ROM is much faster, but because it uses the same methods 


as the paper system, its efficiency is not greatly improved. 
C. THE MINEFACTS DATABASE 


MineFacts is a CD-ROM based database that contains information on all 
landmines that are in use in the world today. It was designed specifically as a tool to 
assist in landmine identification by humanitarian deminers. MineFacts was developed by 
Essex Corporation under contract to the U.S. Army Night Vision and Electronic Sensors 


Directorate and the U.S. Navy Office of Special Technology [MINE 97]. It has been 


on 


distributed to Bosnia, Angola, Croatia, Cambodia and other countries where humanitarian 
demining activities are being conducted. 

The MineFacts database is a way to provide vital information to humanitarian 
deminers. The procedures for identifying and disarming ordnance have always been 
closely guarded secrets, and historically, humanitarian deminers have no references to 
assist them. The U.S. government commissioned the MineFacts database as a way to aid 
and encourage demining. While the database does not contain secret information, it does 


contain useful data on each mine and neutralization methods for most mines. 
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Figure 2.5 MineFacts Search Screen [MINE 97]. 
The database is programmed in Microsoft FoxPro and has a user interface that 
allows mines to be searched by name or characteristics. The user may only search six 
fields: mine type, shape, case material, general size, county of use or the country of 


manufacture (figure 2.5). The selections are limited and do not cover the variation found 


yay 


in the actual mine set. Mines which do not fit in the given options must be listed as 


unknown. 
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Figure 2.6 MineFacts Description Results Screen [MINE 97]. 
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Once the available information has been entered, MineFacts will report the 
number of mines found and allow the user to look at this list, one mine at a time (Figure 
2.6). Each page shows a photo of the mine, nomenclature, general description, and 
country(s) of use and manufacture. More detailed information on each mine is available 
on eight supplementary pages (Figure 2.7). 

Because many mines follow the same basic design, searches based on these few 
parameters can produce very large lists, and paging to find the correct mine can be 
tedious and time consuming. As an example, Figures 2.5 - 2.7 show the results of a 
search for a cylindrical, plastic, antitank mine under six inches in diameter. This search 


produced 109 mines, requiring the user to page through the mines until a photo match 
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Figure 2.7 MineFacts Detailed Mine Information Screen [MINE 97]. 


was found. This search method produces even less useful results when the user cannot 
answer one or more of the search questions. 

This is where an expert system could be applied. It is obvious that the user 
interface is limited on the MineFacts database but adding more options to the query 
would not fully solve the problem. Users may still have incomplete information, or the 
data may not be accurate. An expert system can aid the user in making a positive 
identification with this data, and give the user some level of confidence for its 
recommendations. The system can also explain how it arrived at its decision, allowing 


the user to modify the search as necessary. Chapter III discusses the methodology used to 


construct an expert system for the MineFacts database. 
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Ill. METHODOLOGY 


A. APPROACH 


The intention of this thesis was to develop an intelligent associate to assist 
deminers in Jandmine classification. This identification is based on information gathered 
by the deminer and input into the system. To develop this system, the author first looked 
at the logic required to produce the desired outcome and then determined a plan for 
system development. This chapter will discuss the knowledge base, knowledge 


acquisition, and the methods used to develop the inference engine. 
1. Selection of a Method 


There are many different methods that could be used to create a system for object 
identification. The author’s intention was to follow as closely as possible the approach 
that EOD technicians currently use, while maximizing the use of all available 
information. This required querying the user on as many fields as the database allowed 
and make inferences based on the data provided by the user. This inferred data along 


with the user supplied data, would then be used to derive the identification of the mine. 
Di Selection of Data - Landmine Set 


The first task in this project was to select a landmine set to use with the prototype. 


The landmine set is used to give a defined starting point for an expert to examine the data. 
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The MineFacts database contains 700 landmines which is too large a number to manage, 
so the prototype was limited to the thirty mines in the Bosnian mine subset. Several 
versions of the MineFacts database have been used by humanitarian deminers in Bosnia 
for three years, affirming that the information on these mines is current and correct. 
Although this subset lacks some of the more unusual mines, it does include a fairly broad 
variety of antitank and antipersonnel mines and is a fair representation of the entire 
database. Inclusion of rare mines would require greatly expanding the landmine set and 


is not practical at this time. 


3: Examination of the Landmine Database Fields 


Once the landmine set was identified, the author began a detailed examination of 
the tables and fields in the MineFacts database. All relevant data in MineFacts is carried 
in two separate tables, the ENGLRMKS table and the ENGLDATA table. These tables 
are indexed with the field MINEID and are used to search for and then display 
information and photographs associated with each mine. The ENGLRMKS table 
contains all landmine data with the exception of the fields listing the photos for each 
landmine. The ENGLDATA table only contains a few information fields and is the table 
that the database currently uses for mine queries. The more complete ENGLRMKS table 
was used for the structuring of questions and searching. The ENGLRMKS table will be 


discussed in more detail in Section B. 
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4. Knowledge Acquisition 


Knowledge acquisition is a central part of an expert system [HART 86]. The 
expert knowledge must be collected, examined and represented in a logical format. This 
is very challenging, as many tasks in the identification process are intuitive to the expert 
and therefore difficult to define. The expert collects information on the item, its enna 
other mines in the area, the mine’s condition and the mine’s intended target. This 
information is used by the expert to make certain inferences about the mine before the 
mine is even researched. An experienced EOD technician can determine if a mine is 
antipersonnel or antitank, its effect, country of manufacture, whether it is a scatterable 
mine, and its method of actuation, without ever having seen it before. 

The process of identifying a mine is complex, involving the examination of many 
characteristics. To simplify the process, the problem was broken down into individual 
questions which addressed specific characteristics of the landmine and determined which 
of these questions were supported by fields in the database. Further examination using 
the landmine set allowed me to identify sub-questions that were important to finding a 
solution, without introducing false positive or ambiguous answers that could lead to an 


erroneous conclusion. 


5: Construction of a Question Set 


To generate the questions used to extract query information from the deminer, an 
examination was made of the logical process that is used by expert deminers to identify a 


landmine. As discussed in Chapter II], EOD technicians use a combination of size and 
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visual recognition to make a positive identification of a landmine. Closer examination 
shows that visual recognition involves several steps. The first is the collection of visual 
information such as color or markings that will be used to compare the unknown mine 
with the known mines in the identification guides. Next, the expert makes a mental 
comparison of this visual information from the unknown mine with his or her previous 
experience. This allows the technician to make inferences about the type of mine, its 
function, what country manufactured it, and its method of actuation. These inferences 
assist in making a positive identification and reduce the risk of error. 

The method used to represent the rules for mine taxonomy was the question tree 
shown in Figure 3.1. This method is similar to the dichotomous key used by taxonomists 
to determine the species of a living organism. The difference is that the trees used in the 
expert system allow for more than two answers for each question. Trees were based ona 


single question about a mine’s attribute. Following the question, the number of mines 


Answer (# mines mn this answer) 


Arswer (# mines in this answer) ~ 


Sub-question 
Umrefined Answer Gre Ss See en ee 


Arswer (4 mmes in this answer) 
Question (# of mines represented this question) - - 


Answer ss Unknown 
(Total # mines for sub-question) a 


Answer is Unknown 
(Total # mines for the question) 





Figure 3.1 is an example of the question tree format. 
that the question applied to would be listed in parentheses. Each question was fully 
explored to account for all possible answers for the landmine set. These answers were 


listed on the branches of the question. In cases where the answer needed further 
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refinement, a sub-question was developed to further differentiate the answer. An 
“unknown” branch was added where appropriate to allow the question to be left 
unanswered. These unknown branches are discussed further in Section 6, below. 
Individual question trees representing a query are displayed in Section C. There is no 
single tree displaying all the questions. If the questions were combined into one tree it 


would be so large that it would be difficult to display or understand. 


6. Heuristics 

Once the question trees had been developed the next step was development of 
heuristics. These heuristics are based on general landmine information and are used to 
expand the available data on the unknown mine. This is done by applying the heuristics 
to the user supplied data. The heuristics used for the expert system are explained in more 


detail in Section D. 


7. Dealing with Uncertainty 


This topic will be dealt with in more detail in Chapter IV, but it needed to be 
considered when the questions were developed. Throughout the question process, there 
were several instances of uncertain data and uncertain rules. This was due partly to the 
subjective nature of some questions and, in some cases, the lack of certainty in the 
database. Some questions contained both certain and uncertain outcomes. One example 
is the question of shape. While there is little question what constitutes a cylinder, the 
difference between a rectangle and a square could be very slight and necessitates the 


taking of exact measurements. In addition to subjective uncertainty, there was also 
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uncertainty in the database, in fields where data was not available. Items for which there 
is no available information must be included on every possible branch of the question tree 
to ensure they are not erroneously eliminated. 

The “unknown” branch is found on many of the question trees. This branch is 
used to carry all mines to the next level if the deminer is unable to provide the requested 
information. In some cases, the “unknown” branch falls under a sub-question, and in 
these cases, it is intended to collect all mines of that sub-question and carry them to the 
next level. Once again, this may be due to missing information on the deminer’s part, or 


it may be due to a lack of specificity on the part of the database. 
8. Application of the Question Trees to the Landmine Set 


To test the possible outcomes from the question trees, truth tables were developed 
for all the landmine attributes. These tables list each mine, and the attributes that that 
mine can have. This method allowed testing of the questions and heuristics to investigate 


their applicability. The complete truth tables are listed in Section E. 
B. |§MINEFACTS DATABASE ENGLDATA TABLE 


This section presents a detailed look at the data in the MineFacts database. There 
are fifty-three fields in the ENGLDATA table. This is the heart of the MineFacts 
Database, containing all the text information on each mine. In addition to this text data, 
each mine also has one or more photos in .BMP format that are linked to the record via 


the ENGLRMKS table. 
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While most of the fields of the database are complete, there are a number of fields 
that are blank or have non-standard data. Information is not available on all landmines, as 
the information is often classified or simply not complete when it was collected. 
Nonstandard data presented a lack of continuity within some fields. For example, a 
“Cylinder” was also referred to as a “Flat Cylinder” or “Cylindrical”. Also some fields 
had remarks added such as the size “109mm (not including the tiltrod)”. For this expert 
system, blank fields were treated as unknown, and inconsistencies were corrected. 

Table 3.1 below shows the title for each field in the ENGLDATA table and a 
description for each field. The fields that were used for the expert system are noted with 
an asterisk. The complete ENGLRMKS table for the Bosnian mines can be found in 


Appendix A. 






















Country where the mine has been used 
Antitank or antipersonnel 


*Case Material What material is used to construct the outer case e.g 
metal, plastic, concrete 


*Number of fuze wells The number of the exposed fuze wells on the mine 
e.g. OD green, black gray white 


*Bffect Intended effect of the landmine. Mines can be blast, 
fragmentation, directional fragmentation, bounding 
-_—  — fragmentation, Miznay-Schardin, or shaped-charge 
Longest side of rectangular mine in millimeters, 
otherwise blank 
otherwise blank 
*denotes a field used in by the expert system 
Table 3.1 Fields in the ENGLDATA Table 






3] 


Field Name Field Description 


millimeters 
*Diameter - Max For cylindrical mines, only in millimeters, otherwise 
blank 


Total Weight 
Main Explosive Weight 
Non-Explosive Weight 
Explosive Type 


Fuze Model Model and nomenclature of fuze(s) 


Booster Charge Weight Weight of explosive booster in kilograms, if an 
Max Maximum Time allowed for arming dela 


> 
2 
@, 
oF 
© 


Arm Delay - Min Minimum Time allowed for arming dela 
in meters 

Neutralization Acceptable methods for to neutralize the mine 

Max Penetration For Antitank mines, Max armor penetration in 
millimeters 

Detonation Height For bounding mines, Height of detonation above 


round in meters 


Emplacement Method Scatterable/manual also stake, buried, etc 


Burial Depth - Max Maximum possible depth to base of mine in 
millimeters 


millimeters 
Metal Content 
Metal content Amount 
an 
Self Destruct es/No and Time to self destruction, if an 


Y 
Self Neutralize Yes/No and Time to self neutralization, if an 


*Detectabilit Yes/No Magnetometer Detectabilit 
Anti-handling Yes/No if present 

*Underwater Operations Yes/No and maximum de 
Description 


The text description for the mine. This field can be 
2000 characters long 
Techniques of employment 
*denotes a field used in by the expert system 
Table 3.1 (continued) Fields in the ENGLDATA Table 
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General Information The general information on the mine. This field can 
be 2000 characters long and contains plain English 
information on the mine 


Characteristics 
Components 
Fuze 
Analysist’s Information 
Mine Roller 
Magnetic Mine Countermeasures 
MICLIC 


Bangalore Torpedo/APOBS Yes/No if mine can be neutralized with a Bangalore 
























Torpedo 

Manual Yes/No if mine can be neutralized manually by any 
method 

Visual Visual indications (e.g. tripwires, tiltrods), often 
blank 


Signals from the mine 


*denotes a field used in by the expert system 
Table 3.1 (continued) Fields in the ENGLDATA Table 


Electronic 





Because of the problems with continuity and missing fields as explained 
above, the expert system was limited to the following fields: Nomenclature, Using 
Country, Mine Type, Case Material, Number of Fuze Wells, Case Color, Effect, Length, 
Width, Height, Min/Max Diameter, Detectability, and Underwater Operations. These 
fields represented the most important data on each mine and also were the most complete, 
with fewest blank fields. The questions used to query these data fields are explained in 


the next section. 


C. QUESTION SET 


The questions in this set are derived from information an expert would use to 


make an identification and the fields that were available from the ENGLDATA table. 
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There are other questions that the fields do not support, and some of those questions will 
be found in the heuristics in Section D. These questions are presented in no particular 
order, except in the case of sub-questions for the shape question tree. Each question tree 


diagram displays the results for that question against the Bosnian mine set. 


1. Shape 


Shape is an obvious attribute from the MineFacts database that can be requested 
from the deminer. There are fourteen different shapes in the MineFacts database, but the 
Bosnian set only displays four of these: cylindrical, rectangular, square, and egg-shaped. 
Over 87% of the landmines in the MineFacts database are cylindrical or square [MINE 
97]. The remainder of the mines are rectangular, spherical or some unique shape. The 
determination of the mine’s shape will lead to questions about the length and width or the 


diameter of the mine. 


Cylindrical (20) 
Rectangular (8) 


Rectangular or Square (9) 


Shape (30) 





Figure 3.2 Land Mine Shape Question Tree 
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When dealing with shape, rectangular and square mines must be grouped together 
at this level. The reason is that the deminer may only have an approximate measurement, 
and may mistake a rectangular mine for square. The difference between length and width 
may be only a few millimeters, and since an exact measurement is not always possible, all 
Square and rectangular mines must be carried through the tree to the next level. 

In the question tree, mines with unique shapes are treated as “other” and will be 
separated for identification by their other features. These mines often have shapes that 
are difficult to describe and measurement of these mines may be subjective and error 
prone. Luckily, these mines make up a minuscule number of the overall mine population, 


and their unique shape can be used to “zero-in’’ on their identification. 


ie Cylindrical Size 


The cylindrical size question tree is given below: 


Exact Diameter Measurement - Yes Input Size 


Cylindrical (20) >150 mm (10) 
4 


Exact Diameter Measurement - No <150 mm (10) 
a 





Figure 3.3 Cylindrical Size Question Tree 
The next query level after shape is size. This question is based on the answer to 


the shape question and is, “Do you have the exact diameter measurement for the 
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cylinder?”. If the deminer can acquire exact measurements for the unknown mine this 
will greatly limit the number of possible mines. While an exact measurement is 
preferred, this requires close examination which may not always be possible. For this 
reason, the deminer may approximate the mine’s size and use this to assist in 
identification. 

The cylindrical size question tree only addresses the mine’s diameter. The 
cylindrical mines in the Bosnian mine set can be nicely divided into mines larger or 
smaller than 150mm. Within the Bosnian set, mine diameters in the “under 150mm” 
subset range between 32mm and 103mm. Mines in the “over 150mm” subset range 
between 260mm and 326mm. These size ranges generally hold true for the entire mine 
population and allow for approximations to be made with a high degree of confidence. 


This question is very efficient because it divides the set of cylindrical mines in half. 


DO: Rectangular Size 


Rectangular mines are measured by width and length. The first question asked 
here is, “Do you have an exact measurement for this mine?” (Figure 3.4). If the answer is 
yes the measurement will be input. If the answer is no, the next question is, “What is the 
approximate width?”. To answer this, width must be defined. For our purposes, width is 
assumed to be the shorter of the two measurements. This convention was not universally 
followed in the MineFacts database, and one field from the Bosnian set had to be 


reversed. Width choices are offered for above and below 150mm. This range was 
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selected because it is a good breakpoint between large and small mines. If the width 


cannot be approximated, the question moves to the next level. 


Exact Measurement length/width - Yes Input Size 
=] 


Unknown (8) Length (8) <150mm (4) 
ees 


5 
Exact Measurement - No >150 mm (2) 


>150 mm (6)_ _Length (6) <150mm (4) 
ea 


Width (8) 


<150 mm (2) Length (2) 
Oo 





Figure 3.4 Rectangular Size Question Tree 
The next sub-question in this tree is, “What is the approximate length for the 
mine?”. Here length is defined to the user as the longer of the two sides. The range 
remains the same as for width, above or below 150mm. If the length is unknown, all 
possible mines are carried on the unknown branches. This question is very efficient and 


divides the rectangular mines in the landmine set into three smaller groups. 


4. Square Size 
For square mines, the question is only slightly different from the question for 
rectangular mines. Once again, the first question is for an exact measurement. If this is 


unavailable, the sub-question is, “What is the approximate measurement for the 


oT 


length/width of the mine?” (Figure 3.5). Here the size range is again above or below 


150mm. 


Exact Measurement length/width - Yes Input Size 
— 


Unknown (1) 


Exact Measurement - No 
>150 mm (0) 


Width/Length (1) 


<150 mm (1) 





Figure 3.5 Square Size Sais Tree 
In the landmine set, there is only one square mine, so this shows no distribution. 
In the entire population of mines, this question will not produce much differentiation. 
There are only twenty-six square mines in the MineFacts database and only two are 


smaller than 150mm. 
> Rectangular/Square Size 


The combined shape branch of rectangular or square 1s required to remove some 
of the uncertainty that may occur if an exact measure is unavailable. As stated above, this 
is important to avoid mistakes when the difference between length and width is small or 
the mine is partially obscured. The sub-questions for this tree are very similar to the 
rectangular tree. The only difference is that the exact measurement is not requested and 


the unknown branch appears at every level to allow for partial information. (Figure 3.6) 
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Unknown (9) Length (9) <150 mm (4) 
2 


Uncertain Rectangular or Square (9) 150 mm (3) 
ae 


>150 mm (7) Length (7) <150mm (4) 


a 


Width (9) 


<150 mm (2) Length (2) 
Bee 





Figure 3.6 Uncertain Rectangular/Square Size Question Tree 


6. Height 


The height is completely unrelated to all other landmine characteristics. It can be 
difficult to get for buried mines and requires partial excavation of the mine. Both the 
antitank and antipersonnel mines were distributed over the whole range of sizes. The 
range between 50mm and 150mm is separated from the ranges above and below by a 
25mm buffer. Once again, an exact measurement will greatly limit the number of 


possible mines and make identification much easier. (Figure 3.7) 
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Exact Measurement - Yes 


<50 mm (4) 


Height (30) 


SO0mm=<x<150mm (14) 


Exact Measurement - No 150mm=<x<250mm (1) 





Figure 3.7 Height Question Tree 


Pe Case Material 


Landmines come in a variety of case materials. Metal and plastic are the most 
common, but mines may also be encased in cardboard, fiberglass, bakelite, concrete or 
rubber. They may also be caseless, cast explosive. The division of case material is 
Straight forward at the first level. Determination is not difficult, but some danger of 
misclassification exists, such as between fiberglass and plastic. The determination of a 
case material may also be confused by long exposure to the elements. 

The sub-types of this question allow for a more detailed explanation of the case 
material. Because sheet metal and cast metal are both types of metal, all mines of this 
type are aiso carried on the unknown branch. The unknown branch also carries all other 


types of metal construction which are listed in the database as unspecified “metal”. 


(Figure 3.8) 
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The plastic sub-type takes into account the use of rubber with some plastic mines. 
This is often used as a cover for the mine’s pressure plate and will be visible on top of the 
mine. If the deminer is unsure, the unknown branch again carries all types of plastic 


mines to the next level. 


Cast Metal (1) 


Metal (10) - Sheet metal (3) 


Metal - Unknown (10) 
Plastic only (12) 
Plastic (13) / Plastic whrubber (1) 


Plastic Unknown (13) 


Case Matenal (30) 
————. — ] 
\ Wood (3) 


Fiberglass (2) -- 
Cardboard (1} ~ 
oncrete (1) 


Unknown (30) 
a 





Figure 3.8 Case Material Question Tree 
As noted before, some case materials often are difficult to distinguish after 
weathering. In many cases, the deminer may be able to narrow down the possible case 
materials to two or three possibilities. In these cases a possible method for querying the 


user would be to allow the user to select more than one possible answer from the question 
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tree. The system then efficiently extracts the information from the deminer and reduces 


the uncertainty without using the unknown branch. 


8. Color 

Mines in the Bosnian set are predominately monochromatic. Color is an attribute 
that is extremely subjective, and it could easily lead to mistakes if too many options are 
listed. Most mines are camouflaged to blend in with their intended surroundings. The 
most common color is olive drab (OD) green, but black, gray, brown and unpainted wood 
are also used. Some mines are produced in several different colors for use in different 
environments. Mines are usually only one solid color, but some may have additional 
components of a different color. These combinations are most often OD green and black, 
where black is the color of additional screw-in fuze adapters. Figure 3.9 shows the 
possible answers for the Bosnian mines. 

Color can be very useful to the deminer. The first level of the question tree 
removes mines with more than one color from the group. The second level addresses the 
available colors for the mines. Notice that green is also reduced to light green and OD 
green. | While this is helpful here, it would be even more helpful to add more choices to 
this category in an expanded system. To an EOD technician, the difference between light 
green and pea green is significant and provides important clues about the country of 
origin of the mine. Although additional color choices could be helpful for the expert 


deminer it would most certainly cause confusion for the less experienced. 
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Color (30) One Color (27) 


Light Green (2) 





Figure 3.9 Color Question Tree 
One important feature to notice about the color question tree is that the branches 
at each level add up to more than the initial number of landmines. This is because some 
mines come in more than one color. These mines must be carried on each color branch to 


avoid being missed as possible candidates. 
a. Landmine Effect 


The intended effect of a landmine is an esoteric attribute compared to the other 
physical characteristics of a landmine. The question asked 1s, “What is the intended 


effect of the landmine?” (Figure 3.10). The effect is a feature that may not be apparent in 
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Blast (20) 


Fragmentation (5) 


Bounding Fragmentation (2) 


Mine Effect (30) Fragmentation (8) 
et 


Directional Fragmentation (1) 


Fragmentation - Unknown (8) 





Figure 3.10 Land Mine Effect Question Tree 


all cases, and is difficult to identify without some experience or reference. The question 
tree itself is a straightforward hierarchy, with no unusual levels. However this knowledge 
itself requires a certain level of expertise. 

To determine the possible effect of a mine, a trained EOD technician will examine 
the size, shape, and case material. The technician will also compare the mine with other 
mines in their experience base. Because this question is difficult for the novice to 
answer, heuristics could be used to assist in the determination of the intended effect of the 
unknown mine. By using the information that the deminer is able to gather, the effect 
could possibly be determined, or if the deminer did select an effect, it could be checked 


against the heuristics that apply. 
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10. Number of Visible Fuze Wells 


Fuze wells can be located on the top, sides or bottom of a mine. They are holes in 
the mine case that allow an initiator to be placed in contact with the main explosive 
charge. A fuze well can be used for the main fuze or for an anti-handling device to 
prevent the easy neutralization of the mine. 

The question tree must take into consideration that a deminer may not be able to 
see all of the fuze wells on the mine due to the mine being partially obscured. Landmines 
are usually buried, and though the deminer may partially excavate the mine, some fuze 
wells may be missed or may not be visible because they are on the bottom of the mine. 
For these reasons, the tree 1s constructed so that the smaller number branches include 
mines with more fuze wells to account for miscounts. As an example, all mines are listed 


on the “zero” branch. If one fuze well is located then it will rule out the mines with zero 


0 (1) G0) 
1 (18) (29) 


2 (2) (6) 


Number of visible Fuze Wells (30) 3 (2) (4) 
eee nl 





Figure 3.11 Number of Fuze Wells Question Tree 
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fuze wells. The deminer can answer one and this will account for all mines with one or 
more fuze wells. (Figure 3.11) 

To assist the deminer in identifying what a fuze well looks like, the system will 
have to present an explanation and several examples (Figure 3.12). Some mines have 
holes in the case for rope handles and these may be mistaken as fuze wells. Photographic 
representation of a fuze well and other cavities which may be confused with a fuze well 


will remove some of the uncertainty from this question. 


PENOD, RMR Cpt PENA ODI SON ARREARS ites Mi OAT Kat ht hc BAe AA AAAL GUAANOAAANA OY Nottm a inher she Ahem Neds Sta seem ASAI OR Ne re ah hae mantel tae hate > 206 thse emt nk it heal eeneh, Aamtihtn tokhipaen ec hernia) eh ebchamtet Aas ise tt a reh ar 
: ieee oy, Des yee 


Cet %. Ape 
m Kenic meh O53 tee 

ee Se A Say st hein a / ae ea 
_ % ih) a me +4 AY Oe es G3 








Figure 3.12 PRB M3 Al Antitank mine. Secondary fuze well is noted [MINE 
om 


11. Metal Content 


The MineFacts database has a field that notes the amount of metal found in a 
landmine. Landmines can contain varying amounts of metal, and modern blast mines 


may be completely non-metallic. Mines containing metal can be located with a 
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magnetometer. Once a mine has been located, a trained magnetometer operator can easily 


determine if there is a large or small amount to metal around the mine. (Figure 3.13) 


Strong Magnetometer Signal (30) 


Detectable with a Magnetometer? (30) Yes (30) Weak Magnetometer Signal (11) 
$$$ — 


Magnetometer Signal Magnitude - Unknown (30) 





Figure 3.13 Metal Content Question Tree 
However, detection of metal around a mine does not necessarily mean that the 
mine contains metal. The landmine could be booby-trapped with a metallic anti-handling 
device to prevent its removal, or the area could be contaminated with metal from an 
already detonated mine. This means that the question tree cannot confirm the 


identification of metallic mines, it can only confirm mines that have no metal. 


e o* 
- -_= 
~ Sa ome we. 
~— om 


a? 
‘ 





Figure 3.14 Landmine booby-trapped with a grenade. The pin is removed from the 
grenade and the mine is placed on the spoon. When the mine is moved, the grenade 
functions. In this case, a non-metallic mine appears metallic to the magnetometer 
[SAPP 90]. 
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As an example, if the non-metallic TMA-5 mine is booby-trapped with a hand 
grenade (Figure 3.14), it will produce a strong signal from a magnetometer. If the system 
follows the “Detectable with a magnetometer’ branch, the mine could be erroneously 
eliminated. To prevent the wrong path being followed, the branches for metallic mines 
must also contain the non-metallic mines. 

Once metal has been detected around the mine, a trained magnetometer operator 
can determine if the signal is strong or weak. A weak signal confirms low-metal mines. 
It cannot rule them out by the same reasoning that non-metal mines can’t be ruled out. 
This portion of the question tree must also be weighted to take into consideration the 
subjective nature of “strong” versus “weak” signals. Magnetometers are not 
standardized; several factors may contribute to the subjectivity of strong versus weak; 
operators have different levels of training; and battery power often affects performance. 


The answers to this question should be weighted very lightly. 
12. Mine Type - Intended Target 


This question tree asks for the mine type or intended target. 


Antitank (13) 


Intended Target (30) Antipersonnel (17) 
A EY 





Figure 3.15 Intended Target Question Tree 
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The question asked is, ““ What is the intended target for the unknown mine?”. The 
answer to this question is not always readily apparent to the deminer. Often, an 
experienced deminer can easily identify a mine’s intended target by its size or 
emplacement. Larger mines tend to be antitank mines, and the use of tiltrods or 
emplacement on a road could lead the deminer to believe the mine was antitank. 
Antipersonnel mines are smaller and sometimes use tripwires or have prong-type fuzes. 
Inexperienced deminers may not be able to answer this question, but if they provide 


enough other information, the heuristics may be able to fill in the blank for them. 


13. Underwater Capability 


The underwater capability question tree is given below: 


No (30) 


Maine Emplaced Underwater (30) 


gore Re aes ee 
Yes (29) 





Figure 3.16 Underwater Capability Question Tree 
Not all mines can be used underwater. The question asked here is, “Is the mine 
deliberately emplaced underwater?”. Twenty-nine of the Bosnian mines can be emplaced 
underwater so this question will only rule out one mine from the landmine set. This 
mine, the L.PZ.MI antitank mine, uses a percussion primer and will not function if 


submerged. This question is not as straightforward as it appears. The system must caveat 
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the question with the warning to ensure the mine was deliberately emplaced underwater, 
and was not washed into a river or flooded following emplacement. Because it may not 
be obvious whether submerged emplacement was deliberate, this question will also 


receive a reduced weight against other questions. 
14, Country of Use 


The country of use can be a very useful question to ask of the deminer. 
Information on what country a mine is being used in is usually very accurate. Since it is 


obvious what country the deminer is working in, the input from the user will be very 


County of use 





Figure 3.17 County Where Land Mine is Located 
Question Tree 


reliable. With respect to the landmine set for this thesis, this question has already been 


answered, as the set was limited to only Bosnian mines. (Figure 3.17) 


D. HEURISTICS 
The question trees that are listed above are based on the data fields in the 
MineFacts database. Heuristics allow more data to be collected from the deminer by 


making certain inferences based on the basic information supplied by the deminer. The 
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heuristics used for this system were based on general landmine characteristics. These 


rules were first developed with words to show some degree of certainty (e.g. never, rarely, 


sometimes, often, usually, always). Below is a list of the rules used. 


Blast mines are usually plastic. 

Stake mines are usually cast metal. 

Stake mines are always fragmentation. 

Tripwires are always an indication of an antipersonnel mine. 

Tilt-rod actuated mines are always antitank mines. 

Concrete cased mines are always fragmentation. 

Cast metal mines are always fragmentation. 

Antipersonnel mines are usually smaller than 150mm in diameter or length. 
Antipersonnel mines rarely have carrying handles. 

Antitank blast mines are usually larger than 150mm in diameter or length. 
Antitank mines are usually emplaced on roads. 

Square/rectangular mines are never shaped-charge mines. 

Bounding fragmentation mines are always antipersonnel mines. 
Bounding fragmentation mines are usually metal cased. 

Bounding fragmentation mines are usually round. 

Mines with prongs are always antipersonnel. 

Mines smaller than 40mm high are always blast mines. 

Cardboard mines are always blast mines. 

Serrated metal case mines are always fragmentation. 

Fragmentation mines are usually emplaced above ground. 

Fragmentation mines are always antipersonnel. 

Miznay-Schardin mines are usually circular. 

Miznay-Schardin mines are never smaller that 6 inches in diameter. 
Miznay-Schardin mines are always antitank. 

Directional fragmentation mines are usually square. 

Directional fragmentation mines are usually emplaced vertically with the 
ground. 


These rules were used to generate heuristics in an IF-THEN format. This format 


will allow the user-supplied data to be easily evaluated, and the reasoning explained to 


the user. As an example: 


IF a mine has a carrying handle, 
THEN it is an antitank mine. 
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IF a mine is plastic, 
AND it has no metal, 
THEN it is a blast mine. 

These heuristics are used to fill in blanks in the user supplied data, make 
conclusions and also to check user input against known rules. As an example, examine 
the heuristic: 

IF a mine 1s has a wood case, 
AND it has 2+ fuze wells, 
THEN it is an antitank mine. 

First, the inference engine checks to determine if the user has supplied the 
information needed for this heuristic. If the information isn’t available, the heuristic is 
skipped. If the information is available, as in this case, that the mine is wooden and has 
at least two fuze wells, the system then reasons that the mine is an antitank mine. There 
are three possible outcomes that could be made with this new data: 

1. If the user did not specify that the mine was an antitank mine, the 
inference engine would fill in that blank. 

2. If the user did specify the mine was an antitank mine, then the system 
would move to the next heuristic. 

3. If the user specified that the mine was an antipersonnel mine, the 


system halts and asks the user for clarification pointing out the 


inconsistency. 


a2 


Once this heuristic has been fully explored, the system moves on to the next rule. 
The information from the first heuristic is added to the observed data and can be used for 
the next heuristic. Assume the next rule states: 
[IF a mine 1s antitank, 
AND it has a wood case, 
THEN it is a blast mine. 
If the first rule determined that the mine was indeed an antitank mine, the sub- 
conclusion can be drawn that the mine is also a blast mine. This is data that the user 
could not provide, and is valuable for making a final conclusion about the mine’s 


identification. 


Appendix B contains a complete list of all heuristics used in the expert system. 


E. TRUTH TABLE 

To determine how the landmine set was broken down, a truth table was developed 
displaying the answers for the question trees against the list of the Bosnian mines. They 
were vital for the construction and testing of the expert system. Table 3.2 displays the 
answers for the shape, size and height questions. 

Table 3.3 below displays the continuation of the Bosnian mine truth table. This 
section answers the case material, effect, mine type, and underwater operations questions. 
A “Y” indicated an attribute does not apply to that mine. 

Table 3.4 displays the last page of the Bosnian mine truth table. This section 
answers the number of fuze wells, color and metal content questions. The fuze well 


question is represented here with the actual number of fuze wells first, and then in the 
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remaining columns, the possible number(s) of visible fuze wells. The magnetometer 
fields are used to describe the signal level received when determining metal content of a 


landmine. Mines could all be identified as having “zero” visible fuze wells, but as we 


move across the table, only mines with more fuze wells get a “Y”’. 


Case Material oe setierta 
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MAT-76 Antitank Mine N NOUN N NUN YON N YON NON NN Antitank UY 

TM-100 Antipersonnel Mine .Y N N.N N N N.N N Y.N ON NON ON Antipersonne!l Y. 

TM-200 Antipersonnel Mine Y NNNNNNN WN YN N_N N_N Antipersonnel Y 

TM-62M Antitank Mine © NN Y N-N N NN N Y N N N N_ N Antitank Y. 

L.PZ.MI Antitank Mine 2 N N YY NUN N.N N Y N N N_N__N  Antitank JN 

PMR-1 Antipersonnel Mine N N Y NN NNN NNN N YN _N Antipersonnel Y 

PMA-1A Antipersonnel Mine Y N N N N NN N N Y N_N N_N_CN_ Antipersonnel Y 

PMR-2 Antipersonnel Mine NNNNNNN Y NN NN Y N  \N_  Antipersonnel .Y 

TMA-5 Antitank Mine YON NON N NONUN NY NON NUN UN. Antitank 0 Y 

TMRP-6 Antitank Mine. YO ONON N NOUN NON NON UY NON. NN. Antitank Y 

MRUD Antipersonnel Mine Y NN NNN NWN NNN N Y__Y_N_  Antipersonnel Y 

TMA-2 Antitank Mine Y N N'N N N_.N.N.N Y NN N NN Antitank  £Y 

TMA-3 Antitank Mine N NN NNN Y NN Y NN _N_N'N Antitank — Y 

TMA-4 Antitank Mine  _Y NN ON N.N NN NOY N N_N_N_N Antitank Y 

PMA-1 Antipersonnel Mine NNNNN Y NN N Y N N N_N_N Antipersonnel .Y 

PMA-2 Antipersonnel Mine Y NNNNNNWN WN Y N N N WN N Antipersonnel Y 

PMA-3 Antipersonnel Mine N Y NNN NNN NY N_.N N N_N Antipersonnel Y 

PMR-2A Antipersonnel Mine N N Y N N N N NN N N N Y NN Antipersonnel Y 

PROM-1 Antipersonnel Mine N N Y N N NN NN N_N N Y_ N_ Y= Antipersonnel .Y 

TM-S00 Antipersonnel Mine Y N N N N N N_N N LY ON N N_ N.N Antipersonnel..Y 

MT-4 Antipersonnel Mine N NN WNNWNWN WN Y Y N N N .N_N Antipersonnel Y_ 

PMR-3 Antipersonnel Mine NN Y NY NN NN NN N Y WN N Antipersonnel Y 

TMA-1 Antitank Mine Y NN NNNNN WN Y N N NUN N Antitank Yi 

TMD-2 Antitank Mine NNNNN Y NNN Y N N_N:'N_N  Antitank Y 

PMR-2AS Antipersonnel Mine N N Y N N N N N NN N N Y N N Antipersonnel Y 

PSM-1 Antipersonnel Mine NN Y Y NN NN N N N N Y N_Y = Antipersonnel Y 

MC-71 Antitank Mine N NY NNNN NNN N Y N NN Antitank Y 

TMM-1 Antitank Mine NN Y Y NN NNN Y N N N-CN N Antitank Y 

Type 69 Antitank Mine Y NN NNN NN N.Y N N N_N_N Antitank _ Y 

PMD-1 Antipersonnel Mine N NNNN Y NN N Y N N N _N_N_ Antipersonnel. Y 
Table 3.2 Truth table for the Bosnian landmine set 
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Nomenclature 





TMA-1 Antitank Mine 

TMD-2 Anttank Mne _ 
PIVR-2AS Antipersonne! Mine 
PSM+-1 Antipersonnel Mine 
MC-71 Antitank Mine 
Type 69 Antitank Mine 
PIVD-1 Antipersonne! Mine 


Cyindica B., 
Rectangular 59.0mm 220mm 
Cylindrical 820mm 
Flat cylinder 26mm 
Oylindrical _ 





Oylinder 
Rectanquar 312mm_ 275mm 
Cylindical 

Rectanquar 231.0mm 46.0mm 


_ 830mm, 107.0 mm 


Diameter - Min 





— 108.0nmm 





661mm __ 


Ovlindncal 
Oylindiical 
Oylindnical 
Square 


Oylindrical 


Oylindnical 
Other 


Ovlindiical. 
__ Olindiical 
Rectanquar 200mm 8&9nm 
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Table 3.3 Continuation of the Truth table for the Bosnian landmine set 
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MC-71 Antitank Mine 

TMM-1 Antitank Mine 

Type 69 Antitank Mine 

PMD-1 Antipersonnel Mine 


Table 3.4 Continuation of the Truth table for the Bosnian landmine set 
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F. LIMITS OF THE THESIS 
This thesis is limited in several respects. First, the system is limited to only thirty 
mines. While this is somewhat representative of the whole population of 700 mines, it is 


by no means a complete system. The implementation for these thirty mines makes 
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assumptions and inferences based only on this set. If the entire 700 mines were used, 
these assumptions and questions would have to be refined and re-tested. The second 
limitation is in the overall design. This thesis places emphasis on the EOD knowledge in 
this expert system. It may not represent the most efficient method for constructing an 
expert system. That said, it should also be pointed out that the logic used for the EOD 
portion is sound and correct. This thesis attempts to provide a proof of concept, that an 


expert system could be helpful for the EOD community and deminers. 
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IV. IMPLEMENTATION 


A. OVERVIEW OF THE SYSTEM DESIGN 


This expert system relies on information provided by the user to make a positive 
identification of the landmine. Figure 4.1 is a data flow diagram of how the system is 


designed. 


Available 


Choices 
QUERY 
USER FOR 
UNKNOWN 
Supply MINE 


Requested | INFORMATION 
Mine Data 


| py MINEFACTS DATABASE Read in 
Observed 


CALCULATE Heuristic 
Read in Mine Data Data MORE DATA Rules 


BASED ON 
HEURISTICS 


CONVERT 
MINE 
DATA TO 


ASCH Read in Mine Data 


Mine Data Present 
in ASCII Possible 
Landmines 


ACSII DATABASE 


Output 2 
to Screen 





Figure 4.1 DFD for the Expert System 


Before the program could be used, the data from the MineFacts database (D1) 


would have to be read and converted to ASCII text format. With this information in 


ae 


place, the user (1) can begin a search by providing information to the user interface (1.2). 
This is facilitated by the interface providing answer choices for each query. Once this 
information is collected, it is integrated with the heuristics (D3) to infer additional data 
that the user may not have been able to provide (1.3). The observed and calculated data 
are passed to the search engine (1.4). The search engine compares this data with an 
ASCII version of the MineFacts database to determine the most likely landmine 
candidates. These candidates are output to the screen by nomenclature and photo for final 


selection by the user. 


B. IMPLEMENTATION 

The expert system was implemented on an IBM PC using Microsoft Excel for 
Windows 95. This approach was used to model and test the weights for the expert system 
and was not a full implementation of the heuristics or decision trees. This method was 
selected to allow the rapid prototyping of question weights, which required extensive 
manipulation and testing. The immediate output supplied by the spreadsheet allowed the 
numbers to be quickly changed and evaluated. An analytical programming language 
would not have allowed this type of testing. 

Ultimately, this program should be fully implemented using C++, Java or Ada to 
allow for the user interface and data handling features that these types of languages offer. 
A full implementation could also take advantage of an expert system shell (ESS), which 
would speed construction by providing a framework for input of the knowledge base, 


heuristics and weights. 
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1. Construction 

The model is designed to test weights, and model the use of some simple 
heuristics. Table 4.1 is a scaled down sample from the model. Observed data is entered 
on the bottom row of the table, and each mine receives a probability value (P) for each 
question based on the observed data. If an observed characteristic closely matches that 
characteristic for the mine, it receives a number close to 1.0, if it clearly doesn’t match it 


receives a number close to 0.0. Unknown receives 0.5. 


NOMENCLATURE —— 


Marre [oH 
rie 
rira0 [Fee 
TM-62M | Cyl 
cee [on 


Material Weights LV 
a 
a 
por PLajoso [ass | r08% 
p50 | Mevjoss [eae 8ara% 
oa Paes 
0.90 















= 
“] 





S 


Cyl 
Cyl : 
0.01 ; 
Cyl : 

MA-TA [Reclo.or—«[ SPAS [255 [17.09% 
PMR2 | __cyljo90_— | —<CONJo.05 «13.90 | 60.48% 
TAS «| ~sRecjo.o1 «| ——sPLAJOSO [255 (| 11.00% 
[Fieidweights | 7s [| 8 | | 23 | 10.00% 
[ ObservedData | cru] | mer | | | 


Table 4.1 Shows the format used for the EOD associate model. 


4] U0; U0 


The probability value is then multiplied with the question weight (W) to give a 
confidence factor. Confidence factors for all questions are summed to get a Total Weight 
for each Landmine (TWL). This total weight is divided by the Total Field Weight (TFW) 


to get the Likelihood Value (LV)for each mine. 


WP; + W2P2 + .....WiP) = TWL 
W, + W2+.....Wi = TFW 
TWL/TPW =LV 
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25 Question Weights and Answer Probabilities 


There are several possible outcomes for the questions used by the model. The 
answers to these questions are assigned probabilities to account for uncertainty. This 
uncertainty may be because the answer is difficult to determine, or the answer is very 


similar to other possible answers. 


a. True/False Questions 


True or false answers are weighted as 1.0 or 0.0 respectively. There is no 
uncertainty about the possible answers. Some examples of this type of question are, 


“does the mine have a tripwire?” or, “is the mine a stake mine?” 


b. Choice from Several Clear Choices 


This is a question with multiple answers, but there is a clear separation 
between the possible answers. With this type of question, the user’s answer is assumed to 
be correct since the answers are not subjective. As an example, the Shape question 
assumes that the user can select the correct shape from the given choices of “cylindrical”, 
“rectangular”, “square”, or “other”. For answers where the user could be mistaken, say 


between rectangular and square shapes, the question is handled as a choice from several 


unclear choices, as explained below in Section C. 


C. Choice from Several Unclear Choices 


This situation results when some of the answers are similar to each other. 


The case material question presents exactly this type of problem. The case material for a 
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mine may not always be easy to determine, especially if the mine has been exposed to the 
elements. A user may look at the mine and not be able to tell if it is plastic or fiberglass, 
though they are pretty sure it isn’t metal and are positive it isn’t made of wood or 
concrete. To account for this uncertainty, weights were given to each different case 
material based on its “similarity” to another material. Table 4.2 shows the matrix used in 
the Excel model to manage the case material weights. A value of .99 is a perfect match, 


.O1 is no match, and 0.50 is the value for “Unknown”. 


Se bah ng 
Material Rubber Metal | Metal 
ae I 
[PlastictRubber | 095 | 0.99 | 065 [030| 030 [005 | 005 | 0.05 | 0.05 
[Fibergass [08s [oes [090 [oso oso [aos | 008 [005 [005 
(030 [099 | 0.99] 089[ 005 | 005 | 0.05 | 
[099 [099] 099 [025 [008 | 005 [0.05 | 
5 [099 [099 025 [ose | 005 [0350.05 
aE 







Table 4.2 Matrix of weights used for case material, where some items may be 


easily confused with another. 


Notice the “plastic” row in Table 4.2. An answer of “Plastic” in the 
observed column would produce weights of 0.99 for all the plastic mines, 0.95 for the 
rubber and plastic mines, and 0.85 for the fiberglass mines. The metal mines receive 0.30 
as that category includes some sheet metal mines, and the sheet metal category also 
receives 0.30. The reasoning behind these weights is that fiberglass could easily be 


mistaken for plastic so it receives the high weight of 0.85. Sheet metal is not likely to be 
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mistaken, but it 1s possible if the mine was dirty or wet, so it 1s assigned a value of 0.30, a 


value that is nearer to unknown. 


d. Closeness to Value (Ranges) 


Ranges are used for the “size” questions in the model. When the user 
inputs a measurement for a size question, there must be some allowance for error. This 
could be done by applying weights to the possible range of input values (Table 4.3). For 
example, if a mine was +/- .05 mm from the size input by the user, the certainty factor 
would be 0.99. As the difference from the actual size increases, the certainty factor 


decreases. Sizes that are greater than 5 mm off the exact size are given a certainty factor 


of 0.01. 


Difference from Mine’s Certainty 


Exact Size Factor 


| -05mm | 0.99 
| -10mm | 0 
20mm | 8 


Table 4.3 This table shows the weights for ranges when an exact measure 1s given for an 

item. These certainty factors assume that exact measurements are made using calipers. If 

an exact measurement is not available, the user can always use the approximate ranges to 
describe the size. 





In the model, exact measurements were not addressed. But’ this same 
method works for ranges. As an example, the possible approximations for a mine’s 


diameter are less than 150 mm and greater than 150 mm. If a mine is 135 mm in 
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diameter, it could be given a certainty factor of 0.95 for an answer of less than 150 mm 
and 0.30 for an answer of greater than 150 mm. This would allow some level of error in 


the case the user’s size estimate was incorrect. 


e. Weighting Questions 


Another way to model the logic with the information available is o weight 
certain questions based on their potential value or the overall certainty of their answers. 
In the model, questions were assigned weights between one and twenty. A question with 
a weight of twenty, for example, is considered twenty times more important than a 
question with a weight of one. 

The “shape” question was given a weight of fifteen in the model. It 
received this weight because the user can be expected to easily make a correct 
determination of the mine’s shape. Also, this question provides a great deal of 
differentiation within the data set, and a heavy weight will amplify that differentiation in 
the results. An example of a lightly weighted question is the “underwater emplacement” 
question. Here the user is asked if the mine was deliberately emplaced underwater. This 
prestion, while having only two possible answers, is very uncertain. A mine found 
underwater could have been washed there, or could have been flooded after it was 
emplaced. Also, this question also will only eliminate one mine from the data set. For 


these reasons, this question’s value is very limited, and it is given a low weight. 
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é. Heuristic Certainty Factors 


The heuristics are weighted with a certainty factor that 1s determined by 
the reliability and quality of the data input into the heuristic. This value is important 
when the calculated data is used to fill in for data that the user did not observe. For 
purposes of heuristic weights, observed data is assumed to have a certainty of 1.0 on a 
scale of 0.0 to 1.0. Data calculated with a heuristic may have a certainty factor lower than 
1.0, because it may use data that is uncertain or error prone. This certainty value is used 
to modify the answer weight for a mine. Note, for example, the heuristic below: 


IF a mine is smaller than 150mm in diameter or length, 
AND it is less than 50 mm in height, 
THEN it is an antipersonnel mine (0.75) 


Because, this heuristic deals with size, there is a possibility of uncertainty 
in the generated answer. The input data, that the mine is a certain size may be error prone 
since sizes may be approximate. Also, while this heuristic is almost always true, it is not 
always true. However, there are only two antitank mines for the 700 known landmines 
which could fit this heuristic. For these reasons, the certainty factor for this heuristic is 
set at 0.75. If the heuristic-generated answer “antipersonnel” 1s used, the overall weight 
for that question will be affected: Antitank mines which are lightly weighted at 0.05, will 
move slightly higher, whereas. antipersonnel mines which are weighed as 0.95 will move 


lower. 
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3. Proposed Outputs 
The model will produce an overall certainty for each mine in the Bosnian set and 
list the top five values. The full implementation for the program would offer three 


possible outcomes based on the input and calculated data. 


a. Top Five 

If the user has input enough information to limit the database to a near 
match, the top five candidates will be displayed on the screen. This display would show 
the nomenclature, the certainty factor and a picture of the candidate mines. Figure 4.4 
shows an example of how this information could be shown if the program had a GUI 


written for it. 


b. None Acceptable 


If the results fail to meet a threshold value set by the expert system 
programmer, the system should offer no candidates to the user. This minimum threshold 
is used to protect the user from candidate mines with confidence values that are 
dangerously low. Since the render-safe procedure is based on the mine’s identification, a 
poor answer is worse than providing the user with no answer. If the search failed to 
produce acceptable results, the user would be informed that the information provided 
produced no acceptable candidates. The user would be prompted for a new search, and 


cautioned to recheck the input information. 
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€. Too many acceptable 


In some cases the input and calculated information provided may leave 
more than three acceptable candidates. When this occurs, the user is informed that not 
enough information is available to make an exact determination. The user could then be 
allowed to page through the available choices, enter more information, or begin a new 


search. 


C: TESTING AND RESULTS 

The model was tested in several ways. For the first test, all available data for each 
landmine was entered to see if the system could identify it with the highest confidence 
level. The model was able to do this for twenty of the thirty mines in the Bosnian set. 
The remaining ten mines were identified with the highest value, but were tied with 
another mine. A print-out of the results for each mine can be found in Appendix C. 

The model was next tested to determine how well it handled incomplete 
information. Instead of entering all the data on a mine, only 70% of the data was input. 
For this test, the less obvious attributes were excluded and only shape, color, number of 
fuze wells and approximate length/width or diameter was used. In this test the model was 
able to place the correct mine amongst the top three candidates 87% of the time. The 
exception in this test was with the stake mine category. For these mines, the system 
could not do better than a four way tie. This tie was only broken when the case material 


attribute was added to the available data. 
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The last test involved having a non-expert select four mines at random from the 
Bosnian set. The novice then attempted to describe the mines using the pictures and 
some limited data from the database. The results of this test are listed in Table 4.4. 
Notice that the novice included incorrect information, once for number of fuze wells and 
once for case material. These mistakes did lower the confidence factor, and for the PMD- 


1 caused the correct mine to fall to second place. 






Color, ‘Number of fuze wells, PMA-2 81.07% 
PMR-1 | Shape, Approximate Height and Diameter, | PMR-1 82.72% 
Case Material, Color, (Number of fuze wells) | PMR-3 82.72% 
Stake Mine 82.72% 


Shape, TMD-2 62.62% 
PMD-1 62.43% 



























Approximate Height, Length and 
Width, (Case material), Color, Number of fuze 


wells 
















TMA-2 86.06% 
TMA-5 81.40% 


Shape, Approximate Height, Length and 






Width, Case material, Color, Number of fuze 


wells 





Table 4.4 Results from tests using non-expert supplied data. 


D. PROPOSED USER INTERFACE 


The user interface for this system serves two important functions. First, it is the 
method that the user will use to communicate with the system. The second purpose, is to 
extract the important information about the mine from the user. To accomplish these 


tasks, the interface must be robust, displaying all possible choices with explanations and 
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examples. The proposed interface for the EOD Associate can be divided into three 


sections: Query, Explanation, and Results. 


1. Query Screen 

The expert system asks the user questions about the unknown landmine with a 
query screen. Figure 4.2 shows a possible layout for such a screen. The questions should 
be brief, and all fit on one page if possible. This will speed data entry once the user 
understands the program. Questions are listed with pull-down boxes containing all the 


possible answers in a multiple-choice type format. This focuses the user on the answers 


EOD Associate 


Select Characteristics Check any boxes which 


about the unknown apply to the unknown 
mine from the list below. mine. 


SHAPE [IRM =~] 

HEIGHT [UNKNOWN J 

LENGTH: [UNKNOWN =] 

WIDTH: [UNKNOWN =] 

DIAMETER: [UNKNOWN J 

COLOR: [UNKNOWN J 

METAL CONTENT: [UNKNOWN =x] 

CASE MATERIAL: [UNKNOWN J 
COLOR: [UNKNOWN J 

EMPLACED UNDERWATER [UNKNOWN >] 


NUMBER OF FUZE WELLS: fo ~ 


[~ Is it a Stake Mine? HELP| 


T~ Does it have a Carying HELP 
Handie? Ene 


I Does it have a Tripewie? 
IT Does it have a Tiltrod? HELP | 


CLEAR FORM. | 


SEARCH 


Hep | 
HELE 
HELP | 
Beip| 
HELP| 
dep] 
HELP| 
BELP| 





Figure 4.2 Example of a GUI to be used with the EOD Associate. 
Notice that all fields on the User Query page default to “Unknown”. 
The “HELP” buttons take the user to a screen with examples and text 
describing the requested field. 
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that are recognized by the system. When the user supplies no answer for a specific 


characteristic, the system defaults to “Unknown”. 


De Explanation Screen 


In many cases, the user may not understand the question asked or may want more 
information about the possible answers. By pressing the “HELP” button, the user can 
link to an explanation screen with more information. This help screen could contain text 
and graphical explanations of the question and possible answers. Figure 4.3 shows a help 
screen for the question “Is it a stake mine?’”’. In this case, key features are listed and 


examples are shown. 


STAKE MINES 


A Stake mine is a mine that is secured to a stake and emplaced 
above the ground. This type of mine is omni-directional 
fragmentation, but could be easily confused with a directional 
fragmentation mine. These mines normally are tripwire actuated. 


Helpful ID features: 


*Often Cylinder ot can shaped. 
*Many are made of cast-metal 


*Look for a serrated body 


Back | 





Figure 4.3 This an example of a help screen to assist the user with more detailed 


information about questions on the User Query page. 
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More detailed help screens could be layered to produce a very robust reference 
library. This layered data could be very helpful when describing subjective questions 
such as color. For this type of question, the help screen could show examples of the 
possible colors, and discuss factors which may alter a mine’s color. The help screen 
could even show the examples of the effects of fading, or examples of mines with unusual 


colors. The amount of data available can increase the quality of the user supplied input. 


3. Results Screen 


Once the user has entered all the available information on the mine, candidate 


landmines are displayed on the results screen. Figure 4.4 is a sample output screen. In 


EOD Associate 


The mine listed below are the top three choices based on the 
information provided. 


TMM-1 Antitank mine 


89 86% 
Confidence 


More Information | 


MORE MIN 
TM-62M Antitank mine E ES 


83.59% NEW SEARCH 
Confidence 


More Information | EX) 


TMA-4 Antitank mine 


81.86% 
Confidence 


More Information 





Figure 4.4 This is an example of a GUI page to display the results of a 
search. The confidence values are from an actual search for the TMM- 
1 landmine on the model expert system. 


WZ 


this example, the top three candidate mines are shown with photo, nomenclature and 
confidence value. The key feature of this screen is that the user can make the final 
determination of the correct mine, and this is easily done with a photograph. The user 
can then link to more information about the desired mine with the “More Information” 


button. 
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V. SUMMARY 


Pe SUMMARY OF WORK 

Landmine clearance is one of the most pressing problems in the world today. In 
order for humanitarian deminers to perform this task they must first be able to quickly 
and accurately identify unknown landmines. The existing methods for landmine 
identification involve tedious searching through reference books, looking for a line 
drawing that matches the unknown item or paging through a CD-ROM reference such as 
the MineFacts database. 

This thesis presented the use of an expert system for landmine identification. The 
system is based on the set of thirty Bosnian mines from the MineFacts landmine database 
on CD-ROM. The methodology involved first creating questions based on the more 
obvious attributes. Heuristics were then developed to describe general characteristics of 
the landmine set. The user is queried about the unknown landmine and the answers are 
applied to heuristics which are then used to calculate other information about the mine. 
This collection of information is then filtered through decision trees to generate candidate 
landmines. A small group of candidates are displayed with a confidence factor based on 
each question weight and the supplied answer. 

The system was implemented on an Microsoft Excel spreadsheet. This allowed 
testing of the weights used for the questions and answers.. The completed system was 


based on fifty-one heuristics and fourteen landmine attributes. The system can narrow 
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candidates to within two choices when all queries are correctly answered and to within 
three candidates when 70% of the queries are correctly answered. 

The results from the research show that this technique has potential for all types of 
ordnance identification. A similar system could be implemented to cover all UXOs and 
be used by EOD technicians. It could also be used as a reconnaissance tool by non-EOD 


trained individuals. 


B. THESIS QUESTIONS 
The following questions are addressed in this thesis: 
e Can an expert system be useful in landmine identification? 
Yes, the implementation for the system shows that an expert system does have 
usefulness in landmine identification. With the implementation of a GUI, the 
system would provide the user a much faster and easier method of searching the 
landmine database. 
e How is expert landmine knowledge described? How is the knowledge best 

extracted? 

Expert knowledge is best described as expert experience. Knowledge is 
represented by bits of information about landmine characteristics, and ordnance 
identification is largely pattern matching. This knowledge is best represented 
using heuristics based on the landmines. Extraction of this knowledge was done 


using questions and heuristics. 
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¢ What methodology is best suited for the landmine identification problem? 

The methodology used for this thesis involved determining the bounds of the 

database, developing questions based on those bounds and then developing 

heuristics to support those questions. The question-tree format was very helpful 

in identifying the attributes for each mine. These attributes were then examined to 

determine what general heuristics could be formed to make inferences about other 

attributes. Once the questions and heuristics were developed the system was 

implemented on the Excel spreadsheet. 

¢ What questions and sub-questions are best to implement an expert system that 
will integrate well with the MineFacts database? 

The MineFacts system presented basic questions on shape, size, case material and 

country of use. These were expanded to cover more visual aspects of the mine, 

but the expert system was limited by the fields available in the MineFacts 

database. A complete list of the questions used is in Chapter Ill, Section C. The 

use of a GUI to query the user would greatly enhance the quality of the system to 

extract information. 

e What are possible applications for similar expert systems that could be 
applied to other EOD databases? 

The results to this thesis show that an expert system has potential for all ordnance 


identification. The EOD community could easily use this technology to improve 
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the speed and accuracy of ordnance identification. Further discussion about these 


uses is found in Section C below. 


C: RECOMMENDATIONS FOR FUTURE STUDY 


i Add the Complete landmine Set to the EOD Associate 


The EOD Associate covers only thirty of the landmines currently in use 
worldwide. Since the program is based on the MineFacts database it could be expanded 
to cover the complete mine set. This would allow deminers to easily identify landmines 
with only one reference. It could also allow reconnaissance of minefields by non- 
deminers for referral to landmine clearance teams. Any expansions require some 
modifications to the database, heuristics, and questions. 

As noted earlier, there are some consistency problems in certain fields of the 
MineFacts database. This problem was easily handled with the small set used for the 
program, but will have to be corrected before the full database can be used with an expert 
system. The number of different descriptions appearing in the fields 1s unimportant, but 
duplicate types must match in case and spelling. 

In addition to changes to the MineFacts database, the EOD Associate will have to 
be adjusted to account for the larger variety of values. As an example, the Bosnian mine 
set has only four shapes and eight possible case materials. The complete database will 
expand those fields to sixteen and fifteen respectively. These additional variables are 


sometimes sub-categories of existing variables. In some cases they can be consolidated 
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with other categories to reduce confusion, but many will have to be added to the 


heuristics and decision trees. 
2: EOD 60-Series Publications 


An expert system approach also has potential application to the 60-series 
publications. As previously noted in Chapter II, the method of searching the 60-series has 
not been up-dated to make full use of the computer’s processing power. The search 
method still requires the EOD technician to make subjective judgements about the type of 
ordnance being searched, and also does not make use of identifying features besides size 
to assist in the identification. EOD Associate, or some other expert system could improve 
speed and accuracy by offering more categories and a friendlier user interface. 

The 60-series publications will require some modifications to allow an expert 
system to use the data collected on it. Although the current 60-series is on CD-ROM, it is 
only an automated version of the old microfiche publications. To make it compatible to 
an expert system, a machine-readable database needs to be developed to allow application 
of heuristics and searches. This database could be used by the EOD technician for a 
simple query, or in conjunction with the expert system. Additionally, the current line- 
drawings of ordnance would need to be catalogued and available for display individually 
to allow the user to see available choices on one screen. This could be improved further 


if the line-drawings were supplemented with digitized photographs of the ordnance. 
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3: C4I EOD Reconnaissance System 


One last application for an expert system is as part of a C4I system to improve 
EOD reconnaissance and reporting. Tactical EOD reconnaissance is now done by 
untrained personnel who encounter a UXO hazard. The collection and reporting of the 
information to the EOD unit is not automated and is subject to errors. Often, the 
reporting personnel gather incomplete or inaccurate information, and the EOD Control 
unit must make decisions about the UXO’s disposition based on that information. To 
combat this incorrect information and poor communication, a PC based system could be 
developed for issue to field units as an EOD reconnaissance tool. Figure 5.1 shows one 
possible implementation of such a system. When a UXO is found, the EOD 
reconnaissance computer would be used to gather all the necessary information about the 
item without requiring the individual doing the reconnaissance to remain in the danger 
area for an extended period. The user could take a photo of the ordnance using a tethered 
digital camera. The computer would collect a grid coordinate for the item from the 
Global Positioning System also tethered to the system. The user could then retreat to a 
safe area, and enter the additional data about the ordnance. The expert system could be 
used to prompt for and check the information provided by the user. Once this has been 


accomplished, the photo and collected data could be relayed to the EOD Control Unit by 


wire, radio, or satellite. 
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Figure 5.1 Layout for EOD Recon System 


This type of system would increase the speed and accuracy of UXO reporting. 
The EOD control could easily interpret which ordnance was hazardous and required 


immediate attention, and which could be left for later disposal. 
D. LESSONS LEARNED 


There are several things I learned during the course of this thesis that could be of 
benefit to others working on similar projects. First, the data from the database must be 
correctly formatted. Problems with data consistency and missing data must be addressed 
early in the project’s design. The database should also be machine readable to allow easy 


exchange of data between the database and the expert system. 


8] 


An expert system shell would be very helpful for an expert system such as this 
one. It would reduce the complexity of the programming by providing a framework for 
the knowledge and logic. An ESS would greatly speed the system’s development time. 

Landmine and UXO identification require a high degree of certainty to prevent 
accidents. For this reason, a significant amount of time should be devoted to the 
development of heuristics, weights and testing for the expert system. There is no way to 
assure 100% accuracy in the output, but every opportunity should be taken to eliminate 


the possibility of a dangerous mistake. 


E. CONCLUSION 

Expert systems have tremendous potential for landmine identification. Even more 
important are the potential benefits that expert systems offer for the explosive ordnance 
disposal community. EOD technicians must identify ordnance quickly and accurately 
with information that is not always complete. This thesis has discussed ways that an 
expert system can improve accuracy, speed search time, and increase available 
information to solve these problems. There is no tolerance for a mistake when identifying 


landmines, and an expert system can help ensure that the identification is always correct. 
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APPENDIX A - ENGLRMKS TABLE FROM MINEFACTS V1.2 - BOSNIAN 
MINES 
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APPENDIX B - HEURISTICS 
The following Heuristics apply to the entire population of landmines: 


IF a mine 1s plastic, 
AND it has no metal, 
THEN it is a blast mine (0.99) 


IF a mine has a wood case, 
AND it has 2 or more fuze wells, 
THEN it is Antitank Mine (0.95) 


IF a mine is smaller than 150mm in diameter or length, 
AND it ts less than 60 mm in height, 
THEN it is an antipersonnel mine (0.99) 


IF a mine is less that 40mm in height, 
THEN it 1s a blast mine (0.99) 


IF a mine has a carrying handle, 
THEN it is an antitank mine (0.99) 


If a mine is square/rectangular, 
AND it is emplaced vertically with the ground, 
THEN it is a directional fragmentation mine (0.95) 


IF a mine is fiberglass, 
AND it has no metal, 
THEN it is a blast mine (0.99) 


IF a mine 1s wood, 
AND it has no metal, 
THEN it is a blast mine (.99) 


IF a mine 1s caseless, 
THEN it is a blast mine (0.99) 


IF a mine is on a stake, 
THEN it is a fragmentation mine (0.98) 
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IF a mine has prongs 
THEN it is an antipersonnel mine 


IF a mine is cast metal 
THEN it is a fragmentation mine (0.99) 


IF a mine is fragmentation, 
THEN it is antipersonnel (0.99) 


IF a mine is directional fragmentation, 
THEN it is antipersonnel (0.99) 


IF a mine is bounding fragmentation, 
THEN it is antipersonnel (0.99) 


IF a mine is concrete cased, 
THEN it is a fragmentation mine (0.99) 


IF a mine is cardboard cased, 
THEN it is a Blast mine (0.99) 


IF a mine is blast, 
AND it is antipersonnel, 
THEN it is plastic (0.60) 


IF a mine has Shaped-charge effect, 
THEN it is antitank (0.99) 


IF a mine is Miznay-Schardin, 
THEN it is antitank (0.99) 


The following Heuristics apply to this Bosnian landmines: 


IF a mine is cylindrical, 

AND it is antitank, 

AND it is not light green, 
THEN itis a blast mine (0.95) 


IF a mine is cylindrical, 


AND it is light green, 
THEN it is a PMA-2 antipersonnel Mine(0.95) 
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IF a mine is cylindrical, 

AND it is antitank, 

AND it is OD green, 

THEN it is a blast mine (0.95) 


IF a mine has a fiberglass case, 
THEN it is an antitank mine (0.95) 


IF a mine is cylindrical, 
AND it has a diameter >150mm, 
THEN it is an antitank mine (0.95) 


IF a mine is cylindrical, 

AND it has a plastic case, 

AND it is blast, 

THEN it is an antipersonnel mine(0.95) 


IF a mine is cylindrical, 
AND its has a fiberglass case, 
THEN it is a blast mine (0.95) 


IF a mine is cylindrical, 
AND its has a fiberglass case, 
THEN it is an antitank mine (0.95) 


IF a mine is fiberglass, 
THEN it is a blast mine (0.95) 


IF a mine has 5 fuze wells, 
THEN it is an L.PZ.MI Antitank Mine(0.95) 


IF a mine has 4+ fuze wells, 
THEN it is an antitank mine (0.95) 


IF a mine is gray, 
THEN it is a L.PZ.MI Antitank Mine (0.95) 


IF a mine 1s light green, 
AND it is >150mm, 
THEN it is an TMRP-6 Antitank Mine(0.95) 


IF a mine is light green, 
AND it 1s <15Omm, 
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THEN it is a PMA-2 antipersonnel Mine(0.95) 


IF a mine is OD green and Black, 
THEN it is a antipersonnel mine(0.95) 


IF a mine is OD green and Black, 
AND it is > than 75mm, 
THEN it is a PMA-3 Antipersonnel Mine(0.95) 


IF a mine is OD green and Black, 
AND it is > than 75mm, 
THEN it is a fragmentation mine(0.95) 


IF a mine has a wood case, 
THEN it 1s blast (0.95) 


IF a mine has a wood case, 
AND it has 2+ fuze wells, 
THEN it is TMD-2 Antitank Mine(0.95) 


IF a mine is antitank 
AND it has a wood case, 
THEN it 1s a blast mine (0.95) 


IF a mine has a wood case, 
AND it is rectangular, 
THEN it is an antipersonnel (0.95) 


IF a mine is egg shaped, 
THEN it is a MC-71 Antitank Mine (0.95) 


IF a mine is square, 
THEN it is TMD-2 Antitank Mine(0.95) 


IF a mine rectangular, 
AND it is an antitank mine, 


THEN it is a blast (0.95) 


IF a mine has a sheet metal case, 
THEN it is cylindrical (0.95) 


IF a mine is metal cased, 
AND it is blast, 
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THEN it is an antitank mine (0.95) 


IF a mine has a metal case. 
AND it has prongs, 
THEN it is a Bounding fragmentation mine (0.95) 


IF a mine ts concrete, 
THEN it is PMR-2(0.95) 


IF a mine has a rubber cover, 
THEN it is a PMA-3 antipersonnel mine (0.95) 


IF a mine has a plastic case, 
AND it has prongs, 
THEN it is a blast mine (0.95) 


IF a mine has Shaped-charge effect, 
THEN it is a MC-71 Antitank Mine (0.95) 


IF a mine has no metal, 
THEN it is a TMA-5 (0.95) 


2) 
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APPENDIX C - WEIGHTS USED IN THE EODA MODEL 
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MAT-76 Antitank Mine 
TM-100 Antipersonnel Mine 
TM-200 Antipersonnel Mine 
TM-62M Antitank Mine 
L.PZ.MI Antitank Mine 
PMR-1 Antipersonnel Mine 
PMA-1A Antipersonnel Mine 
PMR-2 Antipersonnel Mine 
TMA-5 Antitank Mine 
TMRP-6 Antitank Mine 
MRUD Antipersonnel Mine 
TMA-2 Antitank Mine 
TMA-3 Antitank Mine 
TMA-4 Antitank Mine 

PMA-1 Antipersonnel Mine 
PMA-2 Antipersonnel Mine 
PMA-3 Antipersonnel Mine 
PMR-2A Antipersonnel Mine 
PROM-1 Antipersonnel Mine 
TM-500 Antipersonnel Mine 
MT-4 Antipersonnel Mine 
PMR-3 Antipersonnel Mine 
TMA-1 Antitank Mine 
TMD-2 Antitank Mine 








PSM-1 Antipersonnel Mine 
MC-71 Antitank Mine 
TMM-1 Antitank Mine 
Type 69 Antitank Mine 
PMD-1 Antipersonnel Mine 





A arn Ladera Lad asl ae 


> ¥4 £ + 


Cylindrical 
Rectangular 
Cylindrical 
Flat cylinder 
Cylindrical 
Rectangular 
Cylinder 
Rectangular 
Cylindrical 
Rectangular 


Rectangular 
Cylindrical 
Cylindrical 
Cylindrical 
Cylindrical 
Rectangular 
Cylindrical 
Cylindrical 
Cylindrical 
Square 









PMR-Z2AS Antipersonnel Mine }Cylindrical 





Cylindrical 
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0.01 1107.0 mm 
0.01 1109.0 mm 
0.01 1101.85 mm 


0.99 
0.01 
Ore 
0.99 




































0.99 0.01 1120 mm 

0.01 0.01 {31.0 mm 0.99 0.01 0.01 0.01 
0.99 0.01 1120 mm 0.01 0.99 0.01 0.01 
0.01 0.011113 mm 0.01 0.99 0.01 0.01 
0.99 0.01 132 mm 0.01 0.96 0.20 0.01 
0.01 0.01 189.0 mm 0.10 0.97 0.01 0.01 
0.01 0.01 1100 mm 0.01 0.99 0.01 0.01 


so 
Gree 
0.01 
0.99 
0.99 


































0.99 0.01 4132 mm 

0.99 0.014178 mm 0.01 0.40 0.01 0.01 
0.01 0.014108.0mm 0.01 0.99 0.01 0.01 
Omg 0.01{500.0mm _ 0.01 0.01 0.01 0.99 
0.99 0.011134.0mm 0.01 0.97 0.01 0.01 
0.99 0.014100.0mm _ 0.01 0.99 0.01 0.01 
0.01 0. 0.01}Unknown 0.50 0.50 0.50 0.50 
0.99 0.01 0.01 0.01 4132 mm 0.01 0.96 0.01 0.01 
0.99 0.01 0.01 0.011135.0 mm 0.01 0.97 0.01 0.01 
0.60 0.01 0.01 0.99{Unknown 0.50 0.50 0.50 0.50 
0.99 0.01 0.01 0.01490.0mm 0.08 0.95 0.01 0.01 
0.99 0.01 0.01 0.01 4100 mm 0.01 0.99 0.01 0.017 
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Rectangular/Square 





AT-76 Antitank Mine 
M-100 Antipersonnel Mine 
M-200 Antipersonnel Mine 
M-62M Antitank Mine 

.PZ.MI Antitank Mine 

MR-1 Antipersonnel Mine 
MA-1A Antipersonnel Mine 
MR-2 Antipersonnel Mine 
MA-5 Antitank Mine 

MRP-6 Antitank Mine 

NRUD Antipersonnel Mine 
MA-2 Antitank Mine 

MA-3 Antitank Mine 

MA-4 Antitank Mine 

IMA-1 Antipersonnel Mine 
MA-2 Antipersonnel Mine 
IMA-3 Antipersonnel Mine 
MR-2A Antipersonnel Mine 
-ROM-1 Antipersonnel Mine 
‘M-500 Antipersonnel Mine 
\T-4 Antipersonnel Mine 
-MR-3 Antipersonnel Mine 
‘MA-1 Antitank Mine 

‘MD-2 Antitank Mine 
-MIR-2AS Antipersonnel Mine 
»SM-1 Antipersonnel Mine 
AC-71 Antitank Mine 

‘MM-1 Antitank Mine 

‘ype 69 Antitank Mine 

»MD-1 Antipersonnel Mine 0.95 89 mm 
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MAT-76 Antitank Mine 
TM-100 Antipersonnel Mine 
TM-200 Antipersonnel Mine 
TM-62M Antitank Mine 
L.PZ.MI Antitank Mine 
PMR-1 Antipersonnel Mine 
PMA-1A Antipersonnel Mine 
PMR-2 Antipersonnel Mine 
TMA-5 Antitank Mine 
TMRP-6 Antitank Mine 
MRUD Antipersonnel Mine 
TMA-2 Antitank Mine 
TMA-3 Antitank Mine 
TMA-4 Antitank Mine 

PMA-1 Antipersonnel Mine 
PMA-2 Antipersonnel Mine 
PMA-3 Antipersonnel Mine 
PMR-2A Antipersonnel Mine 
PROM-1 Antipersonnel Mine 
TM-500 Antipersonnel Mine 
MT-4 Antipersonnel Mine 
PMR-3 Antipersonnel Mine 
TMA-1 Antitank Mine 
TMD-2 Antitank Mine 





PSM-1 Antipersonnel Mine 
MC-71 Antitank Mine 
TMM-1 Antitank Mine 
Type 69 Antitank Mine 
PMD-1 Antipersonnel Mine 


PMR-2AS Antipersonnel Mine 










Case Material 





4 
} 






& 


"Plastic Only. 








Plastic and Rubber 









0.01 
0.01 
0.99 
0.99 
0.01 
0.01 
0.01 
0.99 
0.99 
0.01 
0.99 
0.99 
0.99 
0.01 
0.01 
0.01 
0.01 
0.01 
0.01 
0.01 
0.01 
0.99 
0.99 
0.01 
0.01 


Antipersonnel 
Antipersonnel 
Antitank 
Antitank 
Antipersonnel 
Antipersonnel 
Antipersonnel 
Antitank 
Antitank 
Antipersonnel 
Antitank 
Antitank 
Antitank 
Antipersonnel 
Antipersonnel 
Antipersonnel 
Antipersonnel 
Antipersonnel 
Antipersonnel 
Antipersonnel 
Antipersonnel 
Antitank 
Antitank 
Antipersonnel 
Antipersonnel 


Antitank 0.99 
Antitank 0.99 
Antitank 0.99 


Antipersonnel 0.01 
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Antitank 0.99 
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NAT-76 Antitank Mine 
M-100 Antipersonnel Mine 
M-200 Antipersonnel Mine 
M-62M Antitank Mine 
.PZ.MI Antitank Mine 
PMR-1 Antipersonnel Mine 
PMA-1A Antipersonnel Mine 
PMR-2 Antipersonnel Mine 
MA-5 Antitank Mine 
MRP-6 Antitank Mine 
RUD Antipersonnel Mine 
MA-2 Antitank Mine 
MA-3 Antitank Mine 
MA-4 Antitank Mine 
>MA-1 Antipersonnel Mine 
2>MA-2 Antipersonnel Mine 
2>MA-3 Antipersonnel Mine 
2>MR-2A Antipersonnel Mine 
2>ROM-1 Antipersonnel Mine 
[M-500 Antipersonnel Mine 
VIT-4 Antipersonnel Mine 
2>MR-3 Antipersonnel Mine 
[MA-1 Antitank Mine 
PMD-2 Antitank Mine 
2>MR-2AS Antipersonnel Mine 
2SM-1 Antipersonnel Mine 
iC-71 Antitank Mine 
'MM-1 Antitank Mine 
Type 69 Antitank Mine 
°>MD-1 Antipersonnel Mine 



























¢ |. FR 


0.99 0.01 
0.99 0.01 
0.99 0.01 
0.99 0.01 
0.01 0.01 
0.99 0.01 
0.10 0.01 
0.99 0.01 
0.30 0.99 
0.10 0.01 
0.99 0.01 
O99 007 
0.99 0.01 
0.99 0.01 
0.99 0.01 
0.99 0.01 
0.01 0.01 
0.01 0.01 
0.99 0.01 
O99, C07 
0.01 0.01 
0.99 0.01 
0:99 0.20 
0.01 0.01 
0.01 0.01 
0.01 0.01 
0.99 0.01 
0.99 0.01 
0.99 0.01 


; 
. 


Miznay-Schardin 


0.99 0.01 


a 
eC 
| 


ae 


Shaped-charg 


0.01 
0.01 
0.01 
0.01 
0.01 
0.01 
0.01 
0.01 
0.01 
0.01 
0.01 
0.01 
0.01 
0.01 
0.01 
0.01 
0.01 
0.01 
0.01 
0.01 
0.01 
0.01 
0.01 
0.01 
0.01 
0.01 
oe 
0.01 
0.01 


m 
& 
© 
O 
re 


0.01 
0.01 
0.01 
0.01 
0.01 
0.99 
0.01 
0.99 
0.01 
0.01 
0.40 
0.01 
0.01 
0.01 
0.01 
0.01 
0.01 
0.99 
oo 
0.01 
0.01 
0.99 
0.01 
0.01 
0.99 
0.93 
0.01 
0.01 
0.01 


fon 


__ Fragmenta 





x cu ~* 


$ 


~ Directional Frag 


oO 
© 
5 


0.01 
0.01 
0.01 
0.01 
OIG 
0.01 
0.10 
0.01 
0.01 
0.99 
0.01 
0.01 
0.01 
0.01 
0.01 
0.01 
0.10 
0.10 
0.01 
0.01 
0.10 
0.01 
0.01 
0.10 
0.10 
0.01 
0.01 
0.01 
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0.01 
0.01 
0.01 
0.01 
0.10 
0.01 
0.10 
0.01 
0.01 
0.05 
0.01 
0.01 
0.01 
0.01 
0.01 
0.01 
0.10 
0.10 
0.01 
0.01 
0.10 
0.01 
0.01 
0.10 
0.99 
0.01 
0.01 
0.01 


0.20 0.95 0.40 0.20 0.70 0.20 0.10 
0.20 0.95 0.40 0.20 0.70 0.20 0.10 
0.20 0.95 0.40 0.20 0.70 0.20 0.10 
0.20 0.20 0.20 0.95 0.20 0.20 0.10 
0.20 0.95 0.40 0.20 0.70 0.20 0.10 
0.20 0.95 0.95 0.20 0.70 0.20 0.10 
0.20 0.95 0.40 0.20 0.70 0.20 0.10 
0.20 0.95 0.40 0.20 0.70 0.20 0.10 
0.20 0.70 0.20 0.20 0.95 0.20 0.10 
0.20 0.95 0.40 0.20 0.70 0.20 0.10 
0.20 0.95 0.40 0.20 0.70 0.20 0.10 
0.20 0.95 0.40 0.20 0.70 0.20 0.10 
0.20 0.95 0.40 0.20 0.70 0.20 0.10 
0.20 0.95 0.40 0.20 0.70 0.20 0.95 
0.20 0.95 0.40 0.20 0.95 0.20 0.10 
0.95 0.40 0.40 0.20 0.20 0.20 0.10 
0.95 0.40 0.40 0.20 0.20 0.20 0.10 
0.20 0.95 0.40 0.20 0.70 0.20 0.10 
0.20 0.95 0.40 0.20 0.70 0.20 0.10 
0.20 0.20 0.95 0.20 0.20 0.95 0.10 
0.20 0.95 0.40 0.20 0.70 0.20 0.10 
0.20 0.95 0.40 0.20 0.70 0.20 0.10 
0.10 0.10 0.10 0.10 0.10 0.10 0.95 
0.95 0.40 0.40 0.20 0.20 0.20 0.10 
0.20 0.95 0.40 0.20 0.70 0.20 0.10 
0.20 0.95 0.40 0.20 0.70 0.20 0.10 
0.20 0.95 0.40 0.20 0.70 0.20 0.10 
0.20 0.95 0.40 0.20 0.70 0.20 0.10 
0.20 0.95 
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MAT-76 Antitank Mine 
TM-100 Antipersonnel Mine 
TM-200 Antipersonnel Mine 
TM-62M Antitank Mine 
L.PZ.MI Antitank Mine 

PMR-1 Antipersonnel Mine 
PMA-1A Antipersonnel Mine 
PMR-2 Antipersonnel Mine 
TMA-5 Antitank Mine 
TMRP-6 Antitank Mine 
MRUD Antipersonnel Mine 
TMA-2 Antitank Mine 

TMA-3 Antitank Mine 

TMA-4 Antitank Mine 

PMA-1 Antipersonnel Mine 
PMA-2 Antipersonnel Mine 
PMA-3 Antipersonnel Mine 
PMR-2A Antipersonnel Mine 
PROM-1 Antipersonnel Mine 
TM-500 Antipersonnel Mine 
MT-4 Antipersonnel Mine 
PMR-3 Antipersonnel Mine 
TMA-1 Antitank Mine 

TMD-2 Antitank Mine 
PMR-2AS Antipersonnel Mine 
PSM-1 Antipersonnel Mine 
MC-71 Antitank Mine 
TMM-1 Antitank Mine 
Type 69 Antitank Mine 
PMD-1 Antipersonnel Mine 
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0.05 0.35 0.50 
0.20 0.50 0.45 
0.20 0.50 0.45 
0.05 0.35 0.50 
0.05 0.35 0.50 
0.05 0.35 0.50 
0.20 0.50 0.45 
0:05 0.35 0.50 
0.95 0.50 0.25 
0.05 0.35 0.50 
0.05 0.35 0.50 
0.20 0.50 0.45 
0.20 0.50 0.45 
0.20 0.50 0.45 
0.05 0.35 0.50 
0.20 0.50 0.45 
0.05 0.35 0.50 
0.05 0.35 0.50 
0.05 0.35 0.50 
0.20 0.50 0.45 
0.20 0.50 0.45 
0.05 0.35 0.50 
0.20 0.50 0.45 
0.05 0.35 0.50 
0.05 0.35 0.50 
0.05 0:3570750 
0.05 0.35 0.50 
0.05 0.0140.05 0.35 0.50 
0.01 0.0140.05 0.35 0.50 
0.01 0.0110.05 0.35 0.50 
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